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Abstract 


The purpose of this thesis is to investigate an extension of /x theory for robust control 
design by considering systems with linear and nonlinear real parameter uncertainties. 
In the process, explicit connections are made between mixed /z and absolute stability 
theory. In particular, it is shown that the upper bounds for mixed fi are a generaliza- 
tion of results from absolute stability theory. Both state space and frequency domain 
criteria are developed for several nonlinearities and stability multipliers using the 
wealth of literature on absolute stability theory and the concepts of supply rates and 
storage functions. The state space conditions are expressed in terms of Riccati equa- 
tions and parameter-dependent Lyapunov functions. For controller synthesis, these 
stability conditions are used to form an overbound of the performance objective. 
A geometric interpretation of the equivalent frequency domain criteria in terms of 
off-axis circles clarifies the important role of the multiplier and shows that both the 
magnitude and phase of the uncertainty are considered. 

A numerical algorithm is developed to design robust controllers that minimize 
the bound on an H 2 cost functional and satisfy an analysis test based on the Popov 
stability multiplier. The controller and multiplier coefficients are optimized simulta- 
neously, which avoids the iteration and curve-fitting procedures required by the D-K 
procedure of /x synthesis. Several benchmark problems and experiments on the Mid- 
deck Active Control Experiment at M.I.T. demonstrate that these controllers achieve 
good robust performance and guaranteed stability bounds. 
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Chapter 1 


Introduction 


The implementation of high authority controllers on a system with uncertain pa- 
rameters presents many difficult challenges. Stringent performance objectives often 
require that the controller be optimized with respect to a mathematical model of the 
system. Unfortunately, these models typically do not accurately represent the real 
plant, with the result that the controllers often destabilize the closed-loop system. 
This problem is particularly evident in the field of Controlled Structures Technol- 
ogy [^2], which deals with the control of lightly damped structures. These structures 
are frequently difficult to model well. Furthermore, small changes in some parame- 
ters, such as modal frequencies, can result in large changes in the frequency response 
of the system. In addition, data recent from Shuttle flight experiments illustrate the 
changes due to gravity that can occur in flexible space structures [43]. These changes 
will result in large parameter uncertainties in the system models. Unfortunately, 
many standard control formulations, such as Linear Quadratic Gaussian (LQG or 
H 2 ), may yield extremely sensitive controllers that are not robust to these parameter 
perturbations [7,46,59]. 

Consequently, the goal of much recent research has been to develop design tech- 
niques that yield controllers that are suboptimal in terms of performance, but robust 
to system parameter uncertainties. The elements of the standard synthesis problem 
are shown in Fig. 1.1 with the system G, a controller G c , a performance loop — * z p , 

and an uncertainty block A. For a particular description (or class) of this uncertainty 


15 


W r 


A - 



A 

k+^k 

X/ 

r 






r 

/ 

-wv- 

m 

Wd 

L-j 


V- 

z v 


1 



i 

G 



/ 



1 

u 

-n 


J "“ 

y 

/ 

c 


L 

w 



- G c 








Fig. 1.1: Elements of the robust perfor- Fig. 1.2: Spring mass system with stiff- 
mance problem. ness uncertainty. 

block, a modified design problem is usually specified in terms of the robust stability 
and robust performance problems. The robust stability problem requires that a con- 
troller guarantee asymptotic stability of tbe closed-loop system for all perturbations 
in the class of uncertainties. The more difficult robust performance problem requires 
that the controllers also achieve a specified level of performance for the entire class of 
uncertainties. The central difficulty in solving these two problems is obtaining a model 
that adequately represents the system uncertainty, yet is not overly conservative. 

A good stability analysis tool forms the foundation for many of the best approaches 
to robust control synthesis. Developing an effective analysis tool requires balancing 
the accuracy of the uncertainty description against the computational feasibility of 
the analysis test. It is clear that a good description of the uncertainty is not much 
use if the resulting stability criteria cannot be computed or easily approximated. 
Conversely, simple uncertainty descriptions can result in synthesis techniques that 
are too conservative for practical use. For example, an unstructured representation 
of the uncertainty with a single block A is useful for system uncertainties such as 
unmodelled high frequency modes. However, it is far too conservative an approach 
for a system with multiple uncorrelated uncertainties, which is called a structured 

uncertainty problem. 

A similar problem exists with complex models of real uncertainties. Complex mod- 
els result in simpler analysis tools, but they ignore the phase (0° or 180°) in the real 
uncertainty. The conservatism of these complex models can be clearly demonstrated 
using the simple example of a spring mass system in Fig. 1.2. The stiffness uncer- 
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tainty, which is real and constant, results in the changes shown in Fig. 1.3a. The 
results with a complex model are illustrated in part (b), where the uncertainty is rep- 
resented by a disk in parameter space. The corresponding region in the 5 -plane lies on 
both sides of the Imaginary-axis. The conservatism of the complex model is evident 
by the fact that it erroneously predicts a potential instability for this uncertainty. 
The degree of this conservatism can be quantified by analyzing the roots of the char- 
acteristic equation for the system. These are the given by the zeroes of the equation 
mi 2 + cs -f- k(l -f 6) = 0, with k/m = u 2 and c/m = 2£u ;. If 6 is complex, the stability 
limit is |£| < 2£. If S is real, the only restriction is that 5 > — 1. Since complex values 
of 6 result in changes of the system damping, they place very tight restrictions on the 
uncertainty bounds. These restrictions are particularly severe for structures, which 
typically have modal damping values on the order of 0.5% or less [92]. The conser- 
vatism of these complex models has been one of the key motivations for developing 
accurate but computationally feasible analysis tests for systems with constant real 
parameter uncertainties. 

One of the overall objectives of this thesis is to develop less conservative anal- 
ysis tools for systems with constant real parameter uncertainties. These tests are 
developed as state space stability criteria written in terms of Riccati equations and 
Lyapunov functions. Clarifying frequency domain interpretations of these stability 
tests are also presented. While much of the recent literature on parameter uncer- 
tainty has focused on systems with linear perturbations, we draw on the recent work 
by Haddad and Bernstein [66,67,70,71] and the wealth of literature on absolute stabil- 
ity theory [2,100,119,121,123,131,132,140,172] to consider both linear and nonlinear 
uncertainties. 

The research in this thesis addresses several important issues for robust control. 
First, the analysis directly addresses the issue of real time-invariant nonlinear pa.r a.-m - 
eter uncertainties, and thus is considered to be an extension of y, theory discussed in 
Ref. [47]. As will be discussed, the robustness problem with real time-invariant linear 
uncertainties is extremely difficult to address directly. As a result, many techniques, 
such as mixed fi analysis [53], use approximations or upper bounds to develop com- 


17 


Im (s) 



a) 


t 

x 

I 


Re (s) 




Figure 1.3: Real and complex models of parameter uncertainty in 
the pole location X. Uncertainty in the spring stiffness 
is represented by the uncertainty in the damped modal 
frequency, (a) Real parameter variations, (b) Complex 
parameter variations. 

putationally feasible analysis tools. However, it is shown in this thesis that the upper 
bounds for mixed fi are essentially equivalent to the results from absolute stability 
theory. Furthermore, by explicitly considering these nonlinear uncertainties, it is pos- 
sible to develop physical interpretations of these robustness tests. Finally, because 
the state space stability criteria can be included in an 1~L 2 design problem, the results 
in this thesis provide a powerful tool for robust controller synthesis for systems with 
constant real parameter uncertainties. 

1.1 Background and Previous Research 

As outlined by Bhattacharyya [25], several approaches have been developed to im- 
prove the modelling techniques for the robust stabilization problem with parameter 
uncertainty. Many of these approaches fall within one of six categories: polynomial, 
state space, multiple model, fi, stochastic, and de-sensitization techniques. The fol- 
lowing section provides a brief overview of these approaches, focusing on the classes 
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of uncertainties that they address and the resulting analysis and synthesis tools. 

Polynomial approaches directly analyze the characteristic equation to determine 
the stability of an uncertain system. Included in this category, are the Routh-Hurwitz 
criterion [125], Kharitonov’s theorem [96] with the recent extensions to multiple input 
multiple output systems (MIMO) [25], and the Edge Theorem [15]. These tests 
deal with the zeroes of a family of interval polynomials p(s) = Y^oPiS 1 , where 
0 < Pil < Pi < Pih, i = 1, . . . ,n. Kharitonov’s theorem states that the entire family 
is asymptotically stable if and only if four extreme polynomials are asymptotically 
stable. These extreme polynomials are constructed using the coefficients pu and 
p ih in a specified pattern. For complicated plants, it is often difficult to correlate 
the parameter uncertainty to an uncertainty in the coefficients of the characteristic 
equation of the system. Even if this correlation can be made, there are still further 
difficulties because the polynomial coefficients will be related to each other by the set 
of uncertain parameters. These relationships can be ignored, but this will lead to a 
conservative result. 

The parameter space method has been developed as an alternative to the standard 
Routh-Hurwitz or Nyquist tests for stability [1,32,150]. As discussed in Siljak’s 
overview [150], the approach also deals directly with the roots of the characteristic 
equation. A correlation between the parameter uncertainties and the pole locations 
is used to provide a graphical representation of the system stability in parameter 
space. With several uncertainties, the resulting analysis tools are much simpler than 
the standard Nyquist or Nichols plots [150]. Unfortunately, as with other polynomial 
approaches, it is typically quite difficult to develop and interpret the relationships 
between the uncertain parameters and the roots of the characteristic equation. This 
is particularly true for large order systems with multiple uncertainties. A further 
problem is that these techniques deal only with the problem of robust stability. 

The n oo theory provides a framework for designing controllers that guarantee 
robust stability with an unstructured, complex uncertainty [50,54], This uncertainty 
can be interpreted as a plant uncertainty, an Hoo performance specification, or an 
approximate combination of both [49]. Several authors have investigated a mixed 
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'H.il'Hoo problem specification to add robustness to the LQG controllers [51,65,116, 
137, 168, 175]. Writing the performance specification as an additional uncertainty 
block in the robust stability problem results in a structured uncertainty problem, for 
which Doyle [47] introduced /z- analysis techniques. The difficulty of computing the 
structured singular value /z has led to the development of upper and lower bounds. 
These upper bounds can be refined using the scaling matrices [47]. These refinements 
can then be combined with 'H< x control synthesis to form the so-called D-K iteration, 
where D refers to the scaling matrices and K to the controller design. 

The /z synthesis approach has proven to be an effective technique for designing 
robust controllers for low order systems with a small number of complex uncertain- 
ties [11,117]. The upper bounds for this structured analysis test are not exact for 
a large number of uncertainties [169]. Furthermore, the iterative D—K algorithm is 
non-convex and may result in solutions corresponding to local minima. Since these 
Tfoo, 7f 2 /7^°o, anc * complex /z tests are based on a complex model of the uncertainty, 
they are effective for system errors such as unmodelled high frequency dynamics. 
However, these approaches can be very conservative for systems with constant real 
parameter uncertainties. 

Recent research has focused on the extensions of this complex /z approach to 
develop less conservative analysis tools for systems with real parameter uncertain- 
ties [48,53,113,170]. Again, the difficulty of computing the actual bound requires 
that upper and lower bounds be developed. Research has focused on the continuity 
of these robustness indicators [14,99,127] and the computational aspects of the upper 
and lower bounds for mixed /z [10,53,171]. In both the real and complex /z problems, 
the upper bound can be solved using convex minimization. However, a remaining dif- 
ficulty in the case of real fj, is how to combine these scaling matrices with the original 
plant model to continue the synthesis iteration. 

Recent work by Safonov et al. [34, 140-143, 155] has focused on the multivariable 
stability margin K m , which is related to l//z. They develop a technique for linear 
uncertainties using Generalized Popov Multipliers. Scaling matrices, which are related 
to the ones in the /z framework, are parameterized in terms of this multiplier. The 
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advantage of this approach over real // lies in the way that these multipliers are 
evaluated. Each iteration step of the current fi synthesis algorithm in Ref. [117] 
requires that the optimal multipliers D be evaluated at each frequency point using 
a convex program and then approximated by curve-fitting. Recently, K m synthesis 
has been introduced to eliminate this curve-fitting by formulating a second convex 
problem that directly yields the multiplier coefficients. The rest of the synthesis 
approach is similar to the D—K iteration. As will be seen in later developments, the 
K m approach is related to the analysis techniques developed in this thesis. However, 
these two approaches differ in their interpretation of the analysis techniques and their 
algorithms for robust control synthesis. 

As the name suggests, the goal of the multiple model approach is to design a sin- 
gle controller for several models of the uncertain system [8, 59, 95, 103, 106, 107, 112]. 
These models are used to represent the nominal system and the expected pertur- 
bations. However, it is often difficult to represent all of the expected perturbations 
because the number of models required increases combinatorially with the number of 
uncertainties. Consequently, a smaller number of models, which correspond to par- 
ticular combinations of the uncertainties, are usually selected. The overall objective 
is typically specified as a weighted sum of the closed-loop % 2 performance of each 
system model. Minimizing this objective yields a controller that guarantees stability 
for each of the models. However, there are no such guarantees for other combinations 
of the uncertainties. 

Hagood [74, 75] has recently investigated cost averaging techniques for robust 
control. In his approach, the ?f 2 cost is averaged over a set of systems that vary 
as a continuous function of a set of bounded real parameters. However, because 
numerical approximations of the exact average are computationally intensive, several 
analytical approximations are presented. Hall et al. [77] have recently demonstrated 
that one of these, the Bourret approximation, can be directly related to multiple 
model approaches. 

As discussed by Weinmann [162], several techniques have been developed to di- 
rectly address the sensitivity problems associated with LQG controllers. One ap- 
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proach is to penalize the variations of the optimal cost with respect to changes in 
the plant parameters. The approach by Blelloch and Mingori [26] modifies the LQG 
problem statement to account for structured parameter uncertainty. Terms are added 
to the state and noise weighting matrices to reduce the optimality of the LQG con- 
troller. Mukhopadhyay [114,115] describes a similar technique for developing robust 
LQG controllers using frequency dependent weighting matrices and constraints on the 
singular values of the return difference matrix. Skelton et al. [126,161,167] suggests 
an approach that directly penalizes the sensitivity of the performance objective to pa- 
rameter variations. The key difficulty is that the plant must be augmented with the 
sensitivity states, so that, with m uncertainties, the closed-loop system order increases 
to (m + l)(n + n c ). Sesak [145] modified this approach by eliminating the sensitiv- 
ity states using a singular perturbation reduction. The state and control weighting 
matrices are also modified to account for the reduction, and the result is very similar 
to the one in Ref. [26]. While these approaches are computationally effective tools 
for robust control design, they are ad hoc and offer no a priori robust stability or 
performance guarantees. This is especially true for large parameter variations, where 
the first derivative is insufficient to predict the actual changes in the cost. 

Several approaches to robust control design have been developed based on the 
Linear Quadratic Gaussian/Loop Transfer Recovery (LQG/LTR) methodology [152]. 
As originally developed, the technique provided an effective loop shaping tool for un- 
structured model errors. Although the LQG/LTR controller recovers the guaranteed 
stability margins of a Linear Quadratic Regulator, the approach can be very sensi- 
tive to parameter uncertainties, as demonstrated by Shaked and Soroka [146]. Tahk 
and Speyer [153, 154] present a similar approach for structured uncertainty called 
asymptotic LQG synthesis. In this approach, the weighting matrices of the target 
loop are modified to reflect the structure of the plant uncertainty. The improvement 
of this technique over standard LQG designs is discussed in Ref. [33]. Calise and 
Byrns [30] present an approximate LTR procedure based on the sensitivity methods 
discussed previously. However, a difficulty with this approximate method is that the 
structure of the state weighting matrix restricts the parameter uncertainties that can 
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be considered. 

Several stochastic approaches for parameter robust controllers have been devel- 
oped [87,90,108]. In particular, we consider the so-called Maximum Entropy approach 
developed by Hyland [90] that uses a multiplicative white noise model to capture the 
effects of the parameter uncertainty on the system. In Ref. [21], Bernstein et al. de- 
velop a Lyapunov function for the Maximum Entropy approach to provide a rigorous 
foundation for a technique that has had several interpretations [22,91]. Bernstein and 
Hyland [24] discuss the “left-shift” phenomenon and how it results in robust compen- 
sators for structures with uncertain frequencies. Recent work has demonstrated the 
approach on the Active Control Technique Evaluation Spacecraft (ACES) [38] and 
the two mass benchmark problem [40]. Unfortunately, it is often difficult to correlate 
the uncertainty represented by the stochastic model of the system to the robustness 
levels achieved by the controller. The applicability of the technique is also restricted 
by the required assumptions on the structure of the plant uncertainty [77]. 

The direct method of Lyapunov [100] is an appealing analysis technique because 
it tests for system stability without dealing with the characteristic equation. How- 
ever, the main difficulty with this approach is developing non-conservative Lyapunov 
functions for systems with parameter uncertainty [17,94,101,128,129]. As noted by 
Haddad and Bernstein [66], many quadratic Lyapunov functions do not restrict the 
time variation of the uncertainty and can result in conservative tests for constant 
model errors. A further problem with many state space approaches is imposing the 
structure of the analysis problem with multiple uncertainties [67]. 

Using convex optimization techniques, Boyd and Yang [27] address this conser- 
vatism for their simultaneous stability problem. They consider mixed uncertainties 
and incorporate information about the errors into the structure of the P matrix in 
the Lyapunov function x^Px. In a similar approach, Siljak uses vector Lyapunov 
functions to develop tests for connective stability [149]. These criteria were devel- 
oped for the design of decentralized controllers, but have applications to the problem 
of determining system stability with respect to norm-bounded parameter variations. 
Majorant Lyapunov functions have also been developed for the problem of robust sta- 
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bility for large-scale systems [89]. Haddad and Bernstein have recently developed a 
series of Lyapunov functions that include more information about the uncertainty [69]. 
Recent results in Ref. [20, 67] demonstrate the advantage of tests based on positive 
real models of the uncertainty over those based on bounded gain models. 

Barmish [13] introduced the concept of an adaptive Lyapunov function to reduce 
the conservatism in requiring that a single Lyapunov function guarantee stability for 
the entire class of uncertainties. To achieve a similar goal, Leal and Gibson [98] use 
a first order expansion of a Lyapunov function in terms of the uncertain parameters. 
For certain examples, they demonstrate that the tests provide significantly tighter 

bounds on the actual regions of stability. 

An important recent extension of these two approaches by Haddad and Bern- 
stein [66,69] forms the background for this thesis. The approach is to use parameter- 
dependent Lyapunov functions that explicitly contain the uncertain parameters. Much 
of this work is based on the development of Lyapunov functions of the Lur’e-Postmkov 
form from absolute stability theory [2,123,131]. In this case, for a system with states 
x, output y = cx, and a sector-bounded nonlinear function f(y) in the block A, the 
Lyapunov function is of the form 

V (s, /) = x T Px + 2 f(a) da. (1-1) 

The structure of this Lyapunov function will be developed in detail in this thesis. 
Haddad and Bernstein [66] have shown that, in the linear case with f(a) = Fa, 
Eq. 1.1 can be rewritten as V(x,F) = x T P{F)x. It is the dependence of V on the 
uncertainty F that places beneficial restrictions on the types of functions that can be 

considered. 

As discussed by Haddad and Bernstein [67], the principal limitation of norm-based 
Hoc theory and many quadratic Lyapunov functions is that they employ a complex 
model of the uncertainty which ignores phase information. The result is that the con- 
stant real parameter plant uncertainties are captured as a non-parametric frequency- 
dependent uncertainty. In the time domain, this non-parametric uncertainty can 
be interpreted as including arbitrarily time-varying, sector-bounded nonlinear un- 
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certainties. One technique for considering the constant real parameter robustness 
problem is to restrict the allowable time-variation of these uncertainties. This re- 
striction can be imposed with parameter-dependent Lyapunov functions similar to 
the one in Eq. 1.1. Since V(x,F) explicitly contains the uncertain parameter F, the 
allowable time- variation of this parameter is severely restricted. If the parameter can 
vary as an arbitrary function of time, then the nonnegative definiteness of V{x, F) 
could be subverted [69]. The approach used in this thesis and Ref. [69] is to generalize 
the nonlinearity-dependent Lur’e-Postnikov Lyapunov function of the classical Popov 
criterion to a parameter- dependent Lyapunov function for linear real parameter un- 
certainty. One of the key contributions of this thesis is to present these results in a 
unifying framework and then extend them to consider slope restricted monotonic and 
odd monotonic nonlinear uncertainties. 

1.2 Thesis Objectives and Overview 

The primary goal of this thesis is to develop analysis and synthesis tools that are less 
conservative for real parameter uncertainties [72,81-85]. Much of the recent literature 
on parameter uncertainty has focused on linear perturbations. In this thesis, we 
investigate nonlinear uncertainty models and consider linear uncertainty as a special 
case of this much broader class. In this way, it is possible to develop less conservative 
analysis tools for systems that exhibit nonlinear phenomena, such as spring hardening, 
sensor or actuator saturations, backlash, integrator windup, and certain types of 
friction. To consider these nonlinear uncertainties, this thesis builds on the wealth of 
literature on absolute stability theory [2,100,123,131,132,140,172], 

The focus of this research is on developing both frequency domain and state space 
analysis tests. A graphical interpretation of the frequency domain criteria provides 
insight into the role of the free parameters in the tests. These graphical tests will also 
provide a connection between current analysis tools, such as those in Ref. [53, 171], 
and the results from absolute stability theory. 

Stability criteria are developed in this thesis using the concepts of dissipation , 
supply rates, and storage functions [79,80,165,166], The approach is demonstrated 
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to be an effective technique for developing state space tests for system stability. The 
resulting Riccati equation tests for stability can be directly integrated into an H 2 
design problem using the /2-bound fixed architecture framework [24]. The question 
addressed in this thesis is, given that the state space tests can be incorporated into 
an H 2 synthesis problem, can analysis criteria be developed that are less conservative 
for systems with constant real parameter uncertainty? 

The results in this thesis address several different issues to answer this question. 
First, frequency domain and state space tests for system stability with various classes 
of plant uncertainty are developed. These tests are demonstrated to represent a signif- 
icant improvement over previous state space criteria for robust control. Furthermore, 
these results are used to show the direct connection between absolute stability theory 
from the 1960’s and current fi approaches to robust control. These state space tests 
are then combined with optimal H 2 synthesis to develop controllers that achieve ro- 
bust stability and performance. Finally, several examples and experiments are used 
to show the effectiveness of the design approach for systems with real parameter 

uncertainty. 

Chapter 2 of the thesis outlines some of the mathematical preliminaries for this 
work. In particular, an overview of the storage function and /2-bound frameworks are 
presented because of the essential roles that they play in later developments. The state 
space stability tests are developed in Chapter 3 using supply rates, storage functions, 
and stability multipliers from absolute stability theory. As mentioned, both linear and 
nonlinear functions are used to represent the parameter uncertainties. The results for 
sector-bounded nonlinear functions are presented first. These are then extended to 
include the more specific classes of monotonic and odd monotonic nonlinear functions. 
The nonlinear functions can either be used for nonlinear parameter uncertainties or 
to approximate linear ones. 

Frequency domain tests are also presented to give insight into the role of the 
free parameters in the stability criteria. These tests provide a direct connection 
with current (jl analysis and synthesis techniques. A geometric interpretation of the 
frequency domain criteria also provides an understanding of the role of the scaling 
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functions in these techniques and how they differ from more conservative approaches. 

Chapter 4 builds on the overview of /2-bound techniques outlined in the prelimi- 
naries to give the results for specific classes of multipliers. Both the robust stability 
and robust performance problems are considered. Auxiliary H 2 minimization prob- 
lems are presented. The optimality conditions for the optimal static and (reduced- 
order) dynamic output feedback controllers are also given. The focus in this work 
is on parameter uncertainty, and not on unstructured errors such as high frequency 
unmodelled dynamics. It is assumed that, if necessary, techniques, such as frequency 
weighted cost functionals in the LQG performance specification, have been used to 
address this issue of unstructured model errors [62]. 

Chapter 4 presents the full control design problem for the case with the extended 
stability multipliers. The design process is further clarified in Chapter 5, which 
considers the simpler Popov multiplier. A numerical algorithm is presented to solve 
the optimality conditions. Several of the key numerical issues in the design of the 
robust controllers are also discussed. The relative advantages of the algorithm over 
other synthesis techniques are presented at the end of the chapter. 

Chapters 6 and 7 demonstrate the effectiveness of Popov controller synthesis for 
several systems with real parameter uncertainty. In particular, full and reduced-order 
controllers are designed for several systems with single and multiple uncertainties. 
Three benchmark problems are used to demonstrate the changes in the controllers 
that are required to achieve guaranteed robustness. Several experiments are used to 
demonstrate that the approach is feasible for more realistic systems. In Chapter 7, the 
robust performance achieved with Popov controllers is experimentally demonstrated 
on the Middeck Active Control Experiment (MACE). 


27 


28 


Chapter 2 


Mathematical Preliminaries 

This chapter provides the background material necessary to develop the stability 
criteria in Chapter 3 and the synthesis approach in Chapters 4 and 5. 

2.1 Matrix Transfer Functions 

The basic terminology is presented in the nomenclature. The following provides some 
further key definitions for matrix transfer functions. Let M > 0 (M > 0) denote the 
fact that the Hermitian matrix M is nonnegative (positive) definite. In this thesis, a 
reai -rational matrix function is a matrix whose elements are rational functions with 
real coefficients. Furthermore, it is assumed that a transfer function is a real-rational 
matrix function each of whose elements is proper, i.e., finite at 5 = oo. A strictly 
proper transfer function is a transfer function that is zero at infinity. Finally, an 
asymptotically stable transfer function is a transfer function with all of its poles in 
the open left half plane. The space of asymptotically stable transfer functions is 
denoted by TZHoo, i.e., the real-rational subset of 'H 00 - Let 



denote a state space realization of a transfer function G(s) = C(sl — A) -1 B + D. 
The notation “ 1 ~ l ” is used to denote a minimal realization. 

The W 2 and T~C 00 norms of an asymptotically stable transfer function G(s) are 
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defined as 


( 2 . 2 ) 

(2.3) 


| l GW ll“^/-J |G(j “ )ll|d “ 

||G(s)||oo = sup cr max [G(ju)] ■ 

Prom Ref. [5], a square transfer function G(s) is positive real if: (1) all poles of 
G(s) are in the closed left half plane, and (2) G(s) + G*(s) is nonnegative definite for 
Re[s] > 0. Also, from Ref. [102,163], a square transfer function G(s) is strictly positive 
real if (1) G(s) is asymptotically stable, and (2) G(joj) + G*(j u>) is positive definite 
for all real w. A square transfer function G{s) is strongly positive real if it is strictly 
positive real and D + D T > 0, where D = G( oo). Finally, from Ref. [3], a minimal 
realization of a positive real transfer function is stable in the sense of Lyapunov, and 
from Ref. [102] a strictly positive real transfer function is asymptotically stable. With 
these definitions, we can proceed with an outline of an approach for modelling system 
parameter uncertainty. 

2.2 System Parameter Uncertainty 

The first step in the analysis of an uncertain system is to develop a technique for 
modelling the parameter uncertainties. It is assumed that the uncertain system G(s) 
can be written as 



As illustrated in Fig. 1.1, the plant uncertainty is usually expressed using an internal 
feedback model. The parameter uncertainties are written in terms of new system 
inputs and outputs that are added to the system [113]. These correspond to w T and 
Zr in Fig. 1.1. An assumption in this approach is that the system uncertainty can be 
written as an outer product of two matrices 



The matrices B 0 and C 0 are partitioned to be compatible with the structure of the 
uncertainty, and A is a partitioned to be compatible with the repetition of the un- 
certainties. Note the distinction between A A, the uncertainty in the matrix A, and 
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A, the uncertainty block. The columns of B 0 and the rows of C 0 correspond to the 
B and C matrices of these extra inputs and outputs. 

There is a limitation to this decomposition approach when it is applied to the 
closed-loop system. In this case, with a compensator triple ( A c , B c , C c ), the closed- 
loop dynamics of the system are 


Ad = 


A A “ 

A BC c 
B c C A c 


A BC c 1 r A A A BC c 
B c C A c J [B c aC 0 


( 2 . 6 ) 

(2.7) 


The difficulty arises in the case with nonzero uncertainty in the B or C matrices of 
the plant. Consider the example of a system with uncertainty in the matrix C (aA 
and a B are both zero). Then, as in Eq. 2.5, we can decompose the uncertainty as 
a(7 = BocA c Coc- The uncertainty in the closed-loop system can then be written as 



The result is that the matrices used to decompose the uncertainty depend on the B c 
compensator matrix, which complicates the derivation of the optimality conditions. 
Note, however, that in this case 



which results in several major simplifications. To simplify the developments in later 
chapters, only uncertainties in the matrix A will be considered. 

As discussed in the Introduction, much of this thesis work has been motivated by 
the problem of parameter uncertainties in the control of lightly damped structures. 
The roll-off region of a high authority compensator plays a critical role in determining 
the importance of various modelling errors. If the cross-over frequencies are where 
the loop gain is unity, then the roll-off region consists of the frequency range between 
the first and last of these points. Pole uncertainties are especially important in this ' 
roll-off region, because high performance controllers typically include notches at these 
frequencies [7]. Uncertainty in the zero frequencies is particularly important within 
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the compensator bandwidth, because the zeros are often canceled by compensator 
poles. 

One approach to modelling frequency uncertainty in the plant zeroes is to reflect 
them as an error in the residues of the structural modes. However, this is difficult 
for SISO systems and virtually impossible for MIMO ones. As will be demonstrated 
in Chapter 7 , changing the frequencies of poles in a given frequency range also has a 
large effect on the system zeroes in that range. Consequently, a good approximation 
to the problem with uncertainty in both the poles and the zeroes is just to consider 
the uncertainty in the poles. 

For other uncertainties in the B and C matrices, the approach by Tahk and 
Speyer [ 153 ] can be used to incorporate the uncertainty into the matrix A. If the 
i th column of B (&;) is uncertain, we can add an extra state x b that tracks u { fast 
enough that the filter dynamics (77 > 0) are negligible with respect to the modes that 
Ui controls. The resulting system is 


X 


1 

»*o 

1 


X 

+ 

\Bt" 





0 

-0 

ib 


1 

O 


x b _ 



( 2 . 10 ) 


where B t = B — [0, . . . , b h . . . , 0] and b 0 = [0, . . . , 77, . . . , 0]. A similar approach can 
be used for uncertainty in the C matrix. The plant order must be increased to model 
this uncertainty, but the approach provides a technique for approximating all other 


parameter uncertainties as errors in the dynamics matrix A. 

Two possible state space representations of the open-loop system are 

0 1 


A\ — 


-co 2 -2 (co 


and A2 = 


-(co 

CO\/l — C 2 — (& 


( 2 . 11 ) 


The choice as to which representation is appropriate depends on several factors. Of 
the two, the A 2 representation is better numerically conditioned because it avoids 
quadratic terms in co. Conditioning is a particularly important problem for lightly 
damped structures because ( « 0.01 « 1. In terms of frequency uncertainty, a 
standard approach with both representations is to focus on the imaginary part of the 
pole. This approach essentially ignores the second order effect of the uncertainty on 
the real part of the pole. With the Ai representation, a real constant uncertainty 
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is considered in the frequency squared term, u\ ct = u, 2 (l + £,). Then the actual 
dynamics can be written as 



With the A 2 representation, the frequency is considered to be uncertain, so that 
k>act = ^(1 -f S 2 ). Then, we can write 


(2.13) 


S 2 0 10 

0 S 2 0 1 


i, _ A , 0 -Vy/l ~ C 2 S 2 0 10 

2 uy/1 - C 2 0 0 S 2 0 1 ^ 2 ' 13 ^ 

Note that in this case, the uncertainty S 2 is repeated. The repetition significantly 

complicates the problem formulation, and treating the two frequency uncertainties as 
independent leads to a conservative result. Consequently, the A 1 representation and 
scalar, frequency squared uncertainties are typically used in this thesis. Since S x is 
an uncertainty on cj 2 , its effective uncertainty on u is approximately S-y/2. 

As discussed, the results in this thesis are developed for parameter errors in the 
system matrix A. As before, it is assumed that appropriate B 0 and C Q matrices exist 
to specify the structure of these uncertain parameters. The form of the block A then 
determines the uncertainties that are to be considered. 


To develop a better understanding of the robustness problem, it is important 
to consider several A blocks and the equivalent classes of uncertain functions that 
they represent. Frequency dependent complex A blocks contain no phase informa- 
tion about the parameter uncertainty. These complex robustness tests can be in- 
terpreted as including the class of sector-bounded arbitrarily time-varying nonlinear 
functions [64]. For many problems with real parameter uncertainties, the A block can 
be represented by real time-invariant linear functions. There also exist many cases 
for which real time-invariant nonlinear parameter uncertainties are important. As 
discussed in the Introduction, one approach to the stability problem with real uncer- 
tainties is to develop robustness tests for these time-invariant nonlinear uncertainties. 
In this approach, the aim is to constrain the class of complex uncertainties to develop 
robustness tests that are less conservative for problems with real uncertainties. 

Absolute stability theory provides a technique for developing stability tests with 
nonlinear uncertainties. The theory provides tests to determine stability of a system 
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coupled to an entire class of nonlinear functions. In particular, using the Popov 
stability criteria, it is possible to determine stability for the class of time-invariant 
sector-bounded nonlinear functions [131,132]. Thus, in this thesis, the linear block 
A(y) = Fy of the fi framework is replaced with a nonlinear function A (y) = f{y)- 
By specifying various characteristics of these nonlinear functions, stability tests are 
developed in this thesis for three main classes of nonlinear parameter uncertainties. 
Equivalent frequency domain criteria are used to illustrate that the robustness tests 
include phase information, and are thus less conservative than complex models for 
problems with real uncertainties. 

The arbitrarily time- varying nonlinear function interpretation follows from the 
complex models of the uncertainty. The effort here is aimed at two main goals. The 
first is to use tests that restrict the time-variation of the uncertainty. The second 
goal is to consider more specific classes of nonlinear functions to develop potentially 
less conservative tests. As will be shown in later developments, a key advantage 
of this nonlinear approach to the robustness problem is the physical insight that it 
provides to the stability conditions. Furthermore, the state space stability criteria 
can be used to develop a combined H 2 /real n synthesis algorithm. These points will 
be discussed once the connections to /i analysis are developed in Chapter 3 and the 
synthesis algorithm is presented in Chapters 4 and 5. 

2.3 Supply Rates, Storage Functions, and System Stability 

As discussed by Grujic et al. [60], one of the difficulties with Lyapunov’s direct method 
is developing a framework in which Lyapunov functions can be constructed for systems 
with parameter uncertainty. However, Willems [165,166] and Hill and Moylan [78,80] 
provide such a framework based on the concepts of supply rates, storage functions, 
and system dissipation. This approach plays a vital role in the developments of 
Chapter 3. The purpose of this section is to provide the key definitions necessary to 

develop the framework. 

Consider a dynamic system Q of the form 

i(t) = Ax(t) + Bu{t), (2-14) 
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y(t) = g(x(t)) + Du(t), 


(2.15) 


where u(t) £ R m , y(t) £ R f , and x(t ) £ R n . In the special case where the output func- 
tion is linear ( g(x ) = Cx ) Q = G(s ) is a linear time-invariant (LTI) system with 
realization of the form in Eq. 2.1. 

For the dynamic system Q of Eqs. 2.14 and 2.15, a function r : R* x R m R, is 
called a supply rate if it is locally integrable, so that Jj |r(y(f), «(£))! d£ < oo for all 
ti,t 2 > 0, and if /r(;t/(£),u(£))d£ > 0 for every path that takes the dynamic system 
from some initial state to the same final state. A more general form for the supply 
rate presented in by Pinzoni and Willems [130] will be used in this thesis. Under the 
new definition, the supply rate can be a function of the signals {u, y) and, if they 
exist, their time derivatives. 

Definition 2.1. (Willems [165]). A system Q of the form in Eqs. 2. If and 2.15, 
with states x £ R n is said to be dissipative with respect to the supply rate r(-,-) if 
there exists a nonnegative definite function V, : R n -»• R, called a storage function, 
that satisfies the dissipation inequality 

v s (x(t 2 )) < V.(x(t!)) + f 2 r(y(£), u(0) d£, (2.16) 

Jti 

for all ti , t 2 and for all s(-),y(-), andu(-) satisfying Eqs. 2.14 an d 2.15. 

If V 3 (x) is a differentiable function, then an equivalent statement of dissipative- 
ness [165] of the system Q with respect to the supply rate r: 

U 5 (s(t)) < r(y(t),u(t)), <>0, (2.17) 

where V denotes the total derivative of V(x) along the state trajectory x(t). For a 
strongly dissipative system, Eq. 2.17 is replaced by the condition V 3 (x(t)) < r(y(t), u(t )) 
(x ± 0) with a similar modification to Eq. 2.16. It is assumed in the following that 
the storage functions are differentiable so that the condition in Eq. 2.17 can be used. 

For the particular example of a mechanical system with force inputs and velocity 
outputs, we can associate the storage function with the stored or available energy 
in the system, and the supply rate with the net flow of energy into the system. 
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Fig. 2.1: Two interconnected systems. Fig. 2.2: Interconnection of multiple 

systems for mixed robustness tests. 

However, the concepts of the supply rates and storage functions also apply to more 
general systems for which this energy interpretation is not valid. 

A variety of supply rates have been considered by Willems [165,166] and Hill and 
Moylan [78, 80]. An appropriate supply rate for testing the passivity of a system 
y = G(s)u is r(y,u) = u T y. This choice can be motivated by the same example of a 
mechanical system with a force input and velocity output, so that the product u y is 
the power input to the system. For bounded gain tests, the appropriate supply rate 
is r(y, u) = u T u — 7 2 y T y- A motivation for this choice follows from the identity: 

[ T r(y,u) d t = [ u T u dt - 7 2 / y T y d t. (2.18) 

Jo Jo Jo 

Eq. 2.18 consists of two parts: the first associated with the energy at the system input, 
and the second with the weighted energy at the system output. If the integral on 
the left hand side of Eq. 2.18 is positive, indicating that the weighted output energy 
is less than the input energy at any time T. Then the system is gain bounded, or, 
equivalently, ||G|| oo ^ 'Y 

As will now be shown, storage functions and supply rates provide a means for 
developing Lyapunov functions for determining the stability of coupled feedback sys- 
tems. In particular, if there exists a storage function for each system that is dissipative 
with respect to an appropriate supply rate, then these functions can be combined to 
form a Lyapunov function for the interconnected system. A more precise statement 
of this result for two systems interconnected as in Fig. 2.1 is provided by the following 
lemma. 
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Lemma 2.1. (Willems [165]) Consider two dynamic systems Q\ and Q 2 with 
state space representation as in Eqs. 2.14 an d 2.15, and input-output pairs (u x , y x ) 
and (« 2 , 2/2) respectively. Assume that the two systems are connected as illustrated in 
Fig. 2.1, so that u x = —y 2 and u 2 = y x . Furthermore, associated with these systems 
are states x x , x 2 , supply rates r x (y x ,u x ), r 2 (y 2 ,u 2 ) and storage functions V aX (xi), 
V 32 (x 2 ) respectively. Suppose that both V al (x x ) and V a2 {x 2 ) positive definite, and that 
the supply rates satisfy nfa, u x ) + r 2 (y 2 , u 2 ) = 0, for all Ul = -y 2 and u 2 = y x . Then 
the solution ( x x ,x 2 ) = 0 of the feedback interconnection of Q x and Q 2 is Lyapunov 
stable with Lyapunov function V = V aX + V, 2 . 

Proof. Since V = V aX + V a2 is the sum of two positive definite functions, it is 
positive definite. Furthermore, V{x x ,x 2 ) = V^xJ+V^xJ < r 1 (y 1 ,ti 1 )+r 2 (y 2 ,u 2 ) = 
0. From the positive definiteness of V and the negative semidefiniteness of V, it follows 
that V is a Lyapunov function that guarantees the Lyapunov stability of the solution 
(*1, x 2) = 0. □ 

In the special case that the states x 2 (i) can be written in terms of the states x x (i) 
for all t > 0, then it is possible to relax the assumptions on V a2 in Lemma 2.1. In 
this case, if the storage function V aX is positive definite and the storage function V a2 
is nonnegative definite, then V is positive definite [165]. 

Next, we extend the results of Lemma 2.1 to the case of interest in this thesis, 
where a single LTI system G(s} is interconnected to m independent systems, as il- 
lustrated in Fig. 2.2. In this case, we consider a system G with m scalar inputs 
and outputs such that each U{ is only influenced by y±. The systems in this example 
are special cases of those in Lemma 2.1, because one is LTI and the other is block 
diagonal. 

Corollary 2.1. Consider an LTI system G(s) with inputs U{, outputs y±, i = 
1, . . . ,m, and states x. Introduce the dynamic systems 

ij(f) = AiX{{Fj -f- Biyfit ), 

-Ui{t) = gi{xi{t)), 
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(2.19) 

( 2 . 20 ) 


with supply rates Ti(-Ui(t),yi(t )) and positive definite storage functions V«(x;(i)). 
Define an overall supply rate 

m 

R(yi(t ), . . . , y m (t), u^t ), . . . , u m (t )) = 2 y<(t)), 

i=i 

with n > 0, i = 1, . . • , m. If there exists a positive definite storage function Vg(x) for 
the system G(s ) that is dissipative with respect to the negative of the overall supply 
rate, then the interconnected system is Lyapunov stable. 

Proof. Consider the positive definite function 

m 

V{x,x 1 , . . . ,x m ) = Vg{x ) + '%2'lfiV a i{xi). 

i=i 

From the definition of storage functions, it follows that V«(xi(t)) < ri(—Ui(t),yi(t')), 
i = 1, . . . , m, and Vg{x) < —R(yi(t ), . . . , 2/m(f)) u i(^)j • • • > u m(^))- Then 

m 

y(i(i),ii(f),...,i ra (t)) = VG{x(t)) + ^7iV r s i(x,(t)) 

1=1 

< -i2(v) + S7^i(v) = 0- 

i=l 

where the arguments of the supply rates are dropped for clarity. D 

As before, if the states s x , . . . , x m of the dynamic systems can be written in terms 
of x, then V is positive definite if Vg is positive definite and V,i, i = 1, . . . ,m are 
nonnegative definite. Furthermore, if the positive definite storage function Vg is 
strongly dissipative with respect to the corresponding supply rate — i2( - , •), then the 
Lyapunov function V is positive definite and V is negative definite. It then follows 
that the interconnected system is asymptotically stable. 

The results of Corollary 2.1 convert the problem of determining the stability of 
interconnected systems to that of determining appropriate supply rates and storage 
functions, and then testing for dissipativeness of the independent systems. For the 
problem addressed here, where insights into determining the supply rates are available 
from the characteristics of the nonlinearities, this approach greatly facilitates the 
construction of the Lyapunov functions. Both complex and real uncertainties can be 
incorporated into these tests by mixing the supply rates for the different dynamic 
systems. 
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In the following chapters, a framework is developed that uses the results of this 
section to derive stability criteria with several classes of nonlinear functions. Using 
equivalent frequency domain tests, these absolute stability criteria are related to the 
robust stability problems addressed by real fi. The next section presents the 12-bound 
framework required to incorporate these stability criteria into an control design. 

2.4 The /2-Bound Framework 

The robust stability and robust performance problems were discussed in the Intro- 
duction. This section presents formal definitions of these problems, and shows how 
they can be solved by means of parameter-dependent bounding functions. The result 
is a framework that plays an important role in the later developments of the synthesis 
problem. The following is an overview of the results by Haddad and Bernstein [66,69]. 
Let U C R nXn denote a set of perturbations a A of a nominal matrix A G R nXn . The 
robust stability problem is to determine if A + aA is asymptotically stable for all 
a AeU. 

Robust Stability Problem. Determine whether the linear system 

£(<) = {A + AA)x(t), Vf > 0, (2.21) 

is asymptotically stable for all a A G U. 

To consider robust performance, introduce an external disturbance model involv- 
ing white noise signals as in standard TL 2 theory. The robust performance problem 
focuses on the worst-case H 2 norm over U of the expected value of a quadratic in 
z (t) = Ex(t ), when the system is subjected to a standard white noise disturbance 
u;(i) G R d with weighting D G R nxd . 

Robust Performance Problem. Consider the linear system 

x(t) = (A + AA)x(i) + Dw(t), Vf > 0, (2.22) 

z(t) = Ex(t), (2.23) 

where w(-) is a zero-mean d— dimensional white noise signal with intensity I d and 
E G R 9Xn . The aim is then to determine a performance bound /? satisfying 

J(U)= sup limsupE{||z(f)||^} <0. (2.24) 

A AeU t-*oo 
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The H 2 performance measure in Eq. 2.24 can be expressed in terms of the observ- 
ability Gramian for the pair (A + A A, E). Since D and E may be rank deficient, a 
finite performance bound /3 satisfying Eq. 2.24 may exist even though Eq. 2.21 is not 
asymptotically stable for all perturbations in U. However, in practice, robust per- 
formance is mainly of interest when Eq. 2.21 is robustly stable. The approach here 
is to obtain robust stability as a consequence of the sufficient conditions for robust 
performance. In the following, define the nonnegative definite matrices R = E E and 
V^DD T . 

Lemma 2.2. (Haddad and Bernstein [66]). Suppose A + aA is asymptotically 
stable for all A A £U . Then 

J(U) = sup tr QaaR, (2.25) 

A AQU 

where the n x n matrix Qaa = limt_>oo E[a:(4)a3' r '(i)] is given by 

Qaa= [°° e ^ +A ^ T ‘ d t, (2.26) 

Jo 

that is the unique, nonnegative definite solution to 

0 = (A + aA)Qaa + Qaa{A + aA) t + V. (2.27) 


The connections with traditional Lyapunov function theory are clearer if the H 2 
performance measure is written in terms of a dual variable Pa A- This matrix solves 
a Lyapunov equation in which the roles of A + A A and (A + a A) t are reversed. 

Proposition 2.1. Suppose A + a A is asymptotically stable for all a AgU. Then 

J(U)= sup ItPaaV, (2.28) 

a Aeu 

where Paa € R" Xn is the unique, nonnegative definite solution to 

0 = (A + aA) t Paa + Paa(A + aA) + R. (2.29) 
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Proof. Note that 


teQ& A R = te j Q e^ A+AA ^V e ^ A+AA ^ Tt dtR = tiP AA V, (2.30) 

where 

Paa^ J q °° e( A+ * A ) Tt R e ( A+AA » d t (2.31) 

satisfies Eq. 2.29. □ 

Remark 2.1. In Lemma 2.2, Qaa can also be viewed as the controllability 

Gramian for the pair ( A + aA, D). Similarly, P AA in Proposition 2.1 can be viewed 

as the observability Gramian for the pair ( E , A + a A). □ 

Remark 2.2. The stochastic performance measure J(U ) given by Eq. 2.24 can 
also be written as 

J (U) = sup / \\Ee^ A+AA ^D\\ 2 F d t= sup ||Ga^)|| 2 , (2.32) 

a agujo a Aeu 

where 

Gaa(s) = E[sI ~(A + aAJI^D, (2.33) 

which involves the H 2 norm of the impulse response of Eqs. 2.22 and 2.23. This 
stochastic performance measure can also be given a deterministic interpretation by 
letting w(t) denote an impulse- at t = 0. □ 

The key step in obtaining robust stability and performance is to bound the un- 
certain terms aA t P aa + P aa aA in the Lyapunov Eq. 2.29. These bounds can be 
achieved by using a parameter-dependent bounding function Q(P, aA) that guar- 
antees robust stability by means of a family of Lyapunov functions. As shown in 
Ref. [66], this framework corresponds to the construction of a parameter-dependent 
Lyapunov function (PDLF) that guarantees robust stability. A key feature of these 
PDLF s is the fact that they constrain the class of allowable time-varying uncertain- 
ties. These constraints are very important for reducing the conservatism of the tests 
for systems with constant recil parameter uncertainty. 

Let S r and N r denote the sets of r xr symmetric and nonnegative definite matrices 
respectively. The following result is fundamental and forms the basis for all later 
developments: 
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Theorem 2.1. (Haddad and Bernstein [66]). Let f ?o : N n — * S n and Pq : U —■ ► S n 


be such that 


aA t P + PaA < /2(P, aA) = fto(P) ~[(A + aA) t P 0 (aA) + Po(aA)(A + aA)}, (2.34) 
for all A A&U and P G N n . Suppose there exists P G N n satisfying 



0 = A t P + PA+ Qo (P) + R, 

(2.35) 

such that P + Pq(aA) is nonnegative definite for all aAgZA Then 



(A + a A, E ) is detectable, V aA G U, 

(2.36) 

if and only if 


A + A A is asymptotically stable, V A A G tl. 

(2.37) 

In this case, 


Paa < P + Po(aA), Va AeU, 

(2.38) 

where Paa is 

the solution of Eq. 2.29. Therefore, 



J(U ) < tr PV + sup trP 0 (AA)V. 
AA &U 

(2.39) 

Also, if there 

exists P 0 G S" such that 



P 0 (aA)<P 0 , VaAgZY, 

(2.40) 


then J{U) < 0, where 0 £ tr [(P + P 0 )V\. 

Proof. The details of the proof are presented in Ref. [66]. A key feature in the 
proof is demonstrating the inequality in Eq. 2.38. Rewrite Eq. 2.35 as 

0 = (A + aA) t P + P{A + aA) + (P) - (a A t P + PaA) + R, (2.41) 

for any aA G R nXn . Then, by adding and subtracting the term [(A + aA) t P 0 (aA) + 
P 0 (aA)(A + A A)}, Eq. 2.41 becomes 

0 = (A + a A) t (P + Po(aA)) + (P + Po(aA))(A + a A) + f? 0 (P) + R 

— (aA t P + PaA) - (A + aA) t P 0 (aA) - P 0 (aA)(A + a A), (2.42) 

= (A + a A) t (P + Po(aA)) + (P + Po(aA))(A + aA) + f? 0 (P) + R 

+n(P, a A) - (a A t P + PaA). (2.43) 
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Then, by the assumption in Eq. 2.34, there exists a solution P € N nXn for all a AeU. 
Next, subtract Eq. 2.29 from Eq. 2.43 to obtain 

0 = (A + a A) T [P + P 0 (aA) - P AA ] + [P + Po(aA) - P aa ]{A + a A) 

+0{P, aA) - (aA t P + PaA). (2.44) 

From the detectability conditions, it follows that A + aA is asymptotically stable for 
all a AeU, which in turn implies that P + P 0 (aA) - P AA > 0, yielding Eq. 2.38. □ 

Remark 2.3. If R is positive definite, then the detectability hypothesis of The- 
orem 2.1 is automatically satisfied. □ 

Remark 2.4. Theorem 2.1 can be strengthened by noting that the detectability 
assumption is, in a sense, superfluous. Robust stability concerns only the undisturbed 
system in Eq. 2.21, while R involves the performance weighting. Hence, robust 
stability is guaranteed by the existence of a solution P € N n satisfying Eq. 2.35 with 
R replaced by al n , for some a. > 0. From Remark 2.3, detectability is automatic with 
this replacement. However, for robust performance, P in Eq. 2.39 must be obtained 
from Eq. 2.35. □ 

The last step is to establish connections between Theorem 2.1 and Lyapunov func- 
tion theory. Specifically, it is shown that a parameter-dependent 12-bound establish- 
ing robust stability is equivalent to the existence of a parameter-dependent Lyapunov 
function that establishes robust stability. To show this, assume there exists a positive 
definite solution to Eq. 2.35, let Pq : TA — >■ N n , and define the parameter-dependent 
Lyapunov function 

V(x, aA) £ x T {P + P 0 (aA))x. (2.45) 

Note that, since P is positive definite and Po(aA) is nonnegative definite, V{x) is 
positive definite. Thus, the corresponding Lyapunov derivative is given by 

V{x) = x t [{A + A Af(P + Po(aA)) + (P + P 0 (aA))(A + A A)\x 
= x t [A t P + PA + a A t P + PaA + A t P 0 (aA) + P 0 (aA)A 

+aA t P 0 (aA) + P 0 (aA)aA]s. (2.46) 
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Equivalently, using Eq. 2.35 

V(x) = -x t [(2 0 {P) - {a A t P + PaA 

+(A + aA) t P 0 {aA ) + P 0 {aA){A + a A)} + R}x. (2.47) 

Thus, using Eq. 2.34, it follows that V(x) < 0, so that A + aAis stable in the sense of 
Lyapunov. Asymptotic stability can be shown using La Salle’s Theorem in Ref. [97] 
if V(x) = 0 implies x = 0. Note that V(x) = 0 implies Rx = 0, or equivalently, 
Ex = 0. With x(t) = (A + AA)x(i), Ex = 0, and the detectability assumption in 
Eq. 2.36, it follows from the Popov-Belevitch-Hautus (PBH) test [104] that x = 0, 
which establishes asymptotic stability. 

To apply Theorem 2.1, a function f?o(‘) must be specified and an uncertainty set 
U defined such that Eq. 2.34 holds. If the existence of a nonnegative definite solution 
P to Eq. 2.35 can be determined analytically or numerically and the detectability 
condition Eq. 2.36 is satisfied, then robust stability is guaranteed and the performance 
bound Eq. 2.39 can be computed. The i?(-)-bounds for the examples in this thesis 
are developed in Chapters 4 and 5. 

2.5 Summary 

This chapter outlines some of the key definitions and preliminaries necessary to de- 
velop the analysis and synthesis tools in this thesis. The concepts of supply rates, 
storage functions, and system dissipation are used in the next chapter to provide a 
unifying framework in which Lyapunov functions can easily be constructed. State 
space criteria in terms of Riccati equations and parameter-dependent Lyapunov func- 
tions are developed for systems with several classes of nonlinear parameter uncertain- 
ties. Frequency domain tests from these supply rates are then used to demonstrate 
how these criteria are related to other current approaches to robust control. The 
L?-bound framework is then used to develop synthesis techniques that enforce these 
stability criteria while minimizing an overbound of an 7^2 performance objective for 
the closed-loop system. 
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Chapter 3 


Robust Stability Analysis 


In this chapter, we use the powerful tool of system dissipativity to develop a framework 
for deriving stability criteria for interconnected systems. The concepts of supply rates 
and storage functions from Section 2.3 play a critical role in this development. In this 
unified framework, several classes of memoryless nonlinear functions are considered 
in the state space and frequency domain stability conditions. Furthermore, these 
stability criteria are derived in a way that can easily be incorporated into robust 
stability and performance problems, as will be shown in Chapters 4 and 5. 

The robust stability analysis problem is considered in this chapter for the case of 
nonlinear parameter uncertainties. In this approach, the linear uncertainties used in 
/i analysis are considered to be a special case of this much broader nonlinear class. To 
illustrate the relationship between the two approaches, the discussion in this chapter 
emphasizes the differences in the formulation of the analysis problems with linear and 
nonlinear uncertainties. 

The first three sections of this chapter investigate the stability tests for sector- 
bounded nonlinear functions using the Popov stability multiplier. These sections serve 
to illustrate the storage function and supply rate framework on a simple problem. The 
analysis is then extended to consider the more complex cases of monotonic and odd 
monotonic nonlinearities. The chapter concludes by demonstrating the importance of 
these stability criteria for robust control design. Some important connections between 
the approach in this thesis and concurrent work on mixed fi and K m synthesis are 
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Figure 3.1: Standard framework for stability tests with linear systems and 
complex uncertainty blocks. 

also presented. 

3.1 Development of the Stability Criteria 

We begin with a discussion of the analysis problem with both linear and nonlinear 
uncertainties. Fig. 3.1 illustrates the framework for linear uncertainties in the block 
A. In this thesis, we consider the case of diagonal uncorrelated uncertainties, and 
thus write A = diag(5i, . . . , 5 m )- 

In this linear case, the stability of the interconnected system is typically deter- 
mined using the small gain theorem [44]. State space tests for stability can be de- 
veloped using the bounded gain supply rate in Section 2.3 with the system inputs 
and outputs u(i), y{t ) £ R m . As discussed by Doyle [47], these stability tests can be 
refined using the diagonal scaling functions D(s) (Z? = D* > 0), as shown in the 
figure. Note that in this linear case, v! = D° A ° D~ x ° y' = A ° y', where A ° B 
denotes the convolution of A and B. The result is that the uncertainty block is not 
influenced by the scaling functions, which implies that the properties of the uncer- 
tainty block A, such as magnitude bounds, are unchanged. This, in turn, implies that 
the same form of the supply rate can be used to develop stability criteria with the 
new input-output pair (u 1 , y') instead of (u, y). Of course, the system matrix is now 
G'(s ) = D(s)G(s)D~ 1 (s). The scaling functions D(s) are used to include information 
about the characteristics of the linear uncertainty block in the representation of the 
modified system G'(s). 

A different framework is required for a system G(s) with nonlinear uncertainties, 
as illustrated in Fig. 3.2. The stability tests in this case will be developed using 
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the concepts of passivity. There are several key differences between this nonlinear 
case and the linear approach considered previously. For instance, consider the scaling 
functions. If the uncertainty block A is linear, then it was shown that, because they 
do not directly influence the block A, the scaling functions D are essentially arbitrary. 
However, the same approach cannot be used with nonlinear uncertainties. Consider 
Fig. 3.2 with the linear block A replaced with a class of nonlinear functions /(•). It 
is assumed that this class of functions has a well defined set of characteristics, such 
as sector or slope bounds. As before, we can consider the function from y' to v ! . 
However, the resulting function in this case is /'(•) = D ° /(D -1 0 (•)). This change 
* n f(') indicates that the scaling functions can adversely modify the characteristics 
of the nonlinearities, with the result that the properties of the new class are either 
not known or well defined. In this case, the same form of the supply rate based on 
(u 1 , y') cannot be used, and the advantages of the scaling functions demonstrated in 
the linear case are essentially eliminated. 

Consequently, in this nonlinear case, only a single scaling block, W(s) is used, 
and it is selected based on the known slope or gain properties of the nonlinearity 
/(•) [172]. In the absolute stability literature, W(s) is commonly called a stability 
multiplier. As in the linear case, these multipliers include additional information 
about the nonlinear functions in the stability tests. Note that in this figure, there 
is a forward path from — u to y through G(s) and W (s), and a return path from y 
to u through PF(s) 1 and /(•). These paths correspond to the two systems that are 
considered in the tests for passivity. 

The work in this thesis considers the case illustrated in Fig. 2.2 with m independent 
scalar nonlinear functions in the A block. In this case, /(•) is a component decou- 
pled nonlinearity f(y) = [/i (y x ), . . . , f m (y m )f and W(s) = diag(W 1 (s), . . . , W m (s)). 
Using a different approach, Haddad and Bernstein [66, 69] have considered a full 
uncertainty block for the case of sector-bounded nonlinearities. 

It was demonstrated in Section 2.3 that the process for determining the absolute 
stability of a system coupled to a nonlinear function can be broken down into several 
steps. For each input/output pair of the system G(s), we consider the system Qi with 
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Fig. 3.2 : Standard framework for sta- Fig. 3.3 : Sector bounds for nonlinear 
bility tests with linear systems coupled functions in J 7 (Fi,F 2 ). 
to nonlinearities. 


state space representation given by Eqs. 2.19 and 2.20 that is formed by combining 
/;(•) and Wi(s) -1 . Provided the states of the systems Qi are initialized correctly, they 
can be written in terms of the states x of the LTI system G(s) [165]. A storage function 
is given to demonstrate that each system Qi is dissipative with respect to a supply 
rate r(jji,Ui). These supply rates are combined into r(y,u ) to test the dissipativity 
of the LTI system. We proceed using Corollary 2.1 to demonstrate the asymptotic 
stability of the interconnected system. 

We first consider the case of time-invariant, sector-bounded nonlinear functions. 
An example of the sector bounds for these nonlinear functions is shown in Fig. 3.3. 
The constraint can be written as 

F u < fi(yi) Vi < F 2i yh and /<(0) = 0. (3.1) 

In vector form, with y = [y i, • • . , 2/mf, define F 2 = diag (F 2 i, . . . , F 2m ) , F 2 i € R and a 
corresponding diagonal matrix for Fi. The constraints on the nonlinearities /(•) can 
then be combined as 

(f{y) - F iy f (F 2 - Fa )" 1 (F 2 y - f(y)) > 0, and /( 0) = 0, (3.2) 

which originates from work by Zames [173]. The continuous, memoryless nonlinear- 
ities f(y) that satisfy the restrictions in Eq. 3.2 defines the class J-(Fi, F 2 ). Other 
classes of nonlinear functions will be considered in Sections 3.5.2 and 3.5.3. 
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Equation 3.2 contains two important special cases that are crucial in the develop- 
ment of the stability criteria. The first case is the infinite sector Popov test ( F u = 0, 
F 2 i = oo), which only restricts the elements of f{y) to lie in the first and third quad- 
rants of Fig. 3.3. The second is the principal Popov case (F u = 0, 0 < F 2 i < oo), 
which restricts each gain bounded element of f(y) to lie in the first and third quad- 
rants. These two cases are important because they form the building blocks for 
problems with more general sector constraints. 

3.2 Criteria for Absolute Stability 

Many stability criteria ignore the phase information about the uncertainties and, as 
a result, do not restrict the allowable time variation of the uncertain parameters [64]. 
This failure to restrict the time-variation results in an important degree of freedom 
in the stability analysis of many systems. However, if it is expected that the system 
uncertainties are constant or slowly time-varying, this extra freedom can result in 
added conservatism in the stability test [98]. This research is primarily concerned 
with parameter errors that are assumed to be unknown but constant. As discussed in 
the Introduction, we can explicitly include the nonlinear functions in the Lyapunov 
function to restrict the time-variation of the uncertainty. The following presents a 
systematic development of these so-called parameter-dependent Lyapunov functions 
for sector-bounded nonlinearities. 

The Popov criterion [131] was introduced in 1961 in response to the absolute 
stability problem stated by Lur’e and Postnikov [123]. The appeal of the criterion 
is the simplicity of the test, which is based on the frequency response of the linear 
part of the system. However, the main difficulty with stability tests of this nature is 
determining the appropriate multiplier W(s) in Fig. 3.2. Using a variety of techniques, 
Popov [131], Zames [173], and Brockett and Willems [28,29] have shown that the 
appropriate multiplier is 

W(s) = (I m + Ns), ( 3 . 3 ) 

where N € M = {R mXm ; n tJ - = 0, i ^ j\ n* > 0} . 

Only the form of the multiplier in Eq. 3.3 is considered here. Brockett and 
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Willems [28, 29] point out that the multiplier (J m + Ns) 1 corresponds to the case 
N < 0 in Eq 3.3, which has a simple frequency domain interpretation. However, the 
state space tests are invalid in this case, because they can result in a sign indefinite 
parameter-dependent Lyapunov function. The state space tests can be validated a 
posteriori by confirming that the Lyapunov function is positive definite with a nega- 
tive value of N. 

With this multiplier, we address the derivation of the state space tests with single 
sector ^(0 m , F 2 ) nonlinear functions using the combined supply rate 


r 2 {y,u) = -u T [(» + Ny) - F 2 'u . 


(3.4) 


This supply rate is related to the one in Section 2.3 for tests of system passivity. 
Section 3.5 will discuss the derivation of more complicated versions of this supply 
rate. 

The key point in the following development is the framework of supply rates and 
storage functions in the generation of the Lyapunov functions and Riccati equations 
to test system stability. Similar results have been developed by Narendra [123] and 
Haddad and Bernstein [66] via the Positive Real Lemma or, equivalently, the Kalman- 
Yakubovich Lemma. The goal here is to demonstrate the relative simplicity of the 
storage function framework before it is applied to more complex problems in subse- 
quent sections. We proceed by developing the time domain conditions for asymptotic 
stability of the interconnected systems in Fig. 3.2, dealing with m independent sector- 
bounded nonlinear parameter uncertainties: 

Theorem 3.1. ( [66,83,123]). Consider an LTI system G(s) coupled to m inde- 
pendent nonlinear functions that satisfy the sector constraint 0 < fi{yi) 3 /» — F 2 » 2/i • 
If there exists a multiplier W(s) = (I m + Ns) with N €.Af and a matrix R = R T > 0 
£ R nXn such that 

(i) Ro = {(Ff 1 + NC 0 Bo) + (Ff 1 + NCoB 0 ) T ] > 0, and 

(ii) there exists a symmetric P > 0 that satisfies 
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0 = A t P + PA + R + (Co + NCoA - B?P) T R-\C 0 + NC 0 A - B*P), (3.5) 

then the negative feedback interconnection of the system G(s) and the nonlinearities 
is asymptotically stable. In this case , a Lyapunov function for the 
combined system is given by 

V = x Px + 2j2nu fi(a) da (3.6) 

i=i Jo 

where Co,- corresponds to the row of Cq. 

Proof: The proof of this theorem follows from the results of Corollary 2.1. Con- 
sider a dynamic system Gi with state space representation given by Eqs. 2.19 and 2.20 
that is formed by combining /;(•) and Wf 1 . A storage function can be constructed in 
terms of the states of Gi- These states can in turn be related to the states (x) of the 
LTI system G(s ) [165]. From Corollary 2.1, we can combine these m storage func- 
tions and demonstrate that they satisfy Eq. 2.17 using the supply rate -r 2 (y,u). We 
proceed to show that the interconnection is asymptotically stable by demonstrating 
that the system G(s ) is strongly dissipative with respect to the supply rate r 2 (y,u). 

For the combination of /(■), W(s) in Eq. 3.3, and the supply rate in Eq. 3.4, 
introduce the storage function 

ft ™ ft 

V NL = / u T Nydt = Y^ n ii / u iVi di, 

J o S Jo 

J 71 ' pyi 

= ^2 n » fi(<r)d<r. (3.7) 

i=i Jo 

The functions u { = /,•(?/;) satisfying the constraint 0 < f^yf) y { < F 2i y\ lie in the 
first and third quadrants in Fig. 3.3. Then V NL in Eq. 3.7 represents a s um of the 
areas under each /*(■) curve in Fig. 3.3 and is thus nonnegative. Also, from Eq. 3.2, 
with u = f{y) and = 0, we have that 

V NL = u T Ny, 

< u T Ny + u T (y - F 2 _1 u), 

= u T (y + Ny - Ff'u) = -r 2 (y,u). 
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(3.8) 

(3.9) 
(3.10) 


(3.11) 


For the LTI system, introduce a candidate quadratic storage function 

V G (x) = ^ T Ps, 

Clearly, Vg(x) is a positive definite function if P is a positive definite matrix. Then, 
Eq. 2.17 requires that, for x ^ 0 

V G (x) = \^-x T Px < r 2 (y,u). (3.12) 

2 at 

Next, define r(x,u) = Vg(x) - r 2 (y,u). The condition for dissipation is that 

T{x,u) = x T Pi + u T [(y - F^u) + Ny\ < 0. (3.13) 

Since x — Ax — BqU, y = Cqx, and y = Cqx , Eq. 3.13 can be written as 

r(a:,u) = x t PAx + u T (Co + NCoA — BqP)x — u T \N CqBq + F 2 x )u < 0. (3.14) 

Taking the derivative of r(x,u) with respect to u yields 

= (Co + NCqA - BqP)x - [(F7 1 + NC 0 B 0 ) + (P 2 _1 + NC 0 B 0 ) T ] u. (3.15) 
ou L 

Solving the equation = 0 gives the sequence of inputs u w (t ) that correspond to a 
stationary point in the dissipation function of the system. This solution exists if N is 
selected so that condition (i) of the theorem is satisfied. Furthermore, this condition 
guarantees that the second derivative = — Ro < 0. Then the solution, which 
corresponds to a maximum stationary point in the function T , is given by 

u w (t) = R^\C 0 + NC 0 A - B*P)x{t). (3.16) 

Substitution of u w (t) into the expression for r(x, u) provides a simple way to complete 
the square, and gives the condition that P satisfy 

A t P + PA + (Co + NC 0 A - BZP) t R?(C q + NC 0 A - B%P) < 0. (3.17) 

The selection of any other it(t) = u w (t) + 6u(t)x(t), which includes those possibly 
generated by the nonlinear function f(y), results in a more dissipative system. This 
follows because substitution of u w (i) yields 

r(x,u„,) — x t 6u t Rq 1 6ux < 0. (3.18) 
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where the last term is nonpositive, independent of the form of Su(t). Consequently, 
u w (t) represents the worst case input in the sense that it minimizes the dissipation 
of the system. To guarantee that the system be dissipative, it is sufficient to require 
that this worst case input result in a negative maximum of r(s,u^). Thus, select 
R = R T > 0, and require that max u T(a:,it) = ~^x T Rx < 0. Applying this constraint 
to Eq. 3.17 gives Eq. 3.5. Then, because P = P T > 0, the quadratic function V G {x) 
is a positive definite storage function for the system. 

Since y = Cox, we can write yi = CoiX in the storage functions. From Corol- 
lary 2.1, adding the two storage functions in Eqs. 3.7 and 3.11 yields the Lyapunov 
function 


V = 2V G + 2V NL 

rp „ JZL fCoiX 

= xPx + 2^2na /;(cr)dcr. (3.19) 

i = i Jo 

which shows the explicit dependence on the nonlinear functions. □ 

3.3 General Sector Bounds 

The approach of the preceding section can easily be extended to the general sector 
problem, where the diagonal elements of both F 2 and F 1 are nonzero. The advantage 
of this form of the sector constraints is that it does not place limitations on the sign 
of the uncertainty. As might be expected, the symmetric case —F\ = F = F 2 is of 
particular importance. 

The pole-shift technique of Rekasius and Gibson [133] is shown in Fig. 3.4. This 
transformation is closely related to the Linear Fractional Transformations (LFT’s) 
that play a key role in fi analysis [171]. The system transformation relates the prob- 
lems with general sector bounds to the single sector problems considered previously. 
It is assumed in this analysis that F 2 !> 0 and F 2 > so that the admissible regions 
in Fig. 3.3 exist. The shifted system G has inputs —u, outputs y , and a state space 
representation 


x = Ax + B 0 (-u - Eiy), 

= (A - B 0 FiC 0 )x - B 0 u, (3.20) 
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G 


/(•) 

Figure 3.4: The general sector to finite sector transformation, with 
corresponding definitions of G, u, and /(•). 

y = C 0 x, (3.21) 

where, as defined in the figure, u = f{y) = u — F\y. The pole-shift procedure trans- 
forms / in F(F U F 2 ) to the nonlinear function /(•) in the class jF(O m , F 2 — F\). 

To proceed, use the inputs and outputs of this transformed system to redefine the 


supply rate in Eq. 3.4 as 


^(y, fi) = -fi T [( y + Ny) - N d u ] , 

(3.22) 

= -(it - Fiy) T ((y + Ny) + F d F].y - F d u ), 

(3.23) 

= -{u - F iy ) T F d {F 2 y -u)-(u- F iy ) T Ny, 

(3.24) 


where F d = (F 2 - Fi) -1 . Eq. 3.23 follows from Eq. 3.22 using the definition of u. 
Finally, Eq. 3.24 is a consequence of the fact that (J m + F d Fi)y = F d F 2 y. 

Similarly, the storage function for this case can be developed using Eq. 3.7 with 
/(•) to obtain 

V NL = f f T {y)Ny dt = [ {u-F iy f Nydt. (3.25) 

Jo Jo 

Again, the function V NL is nonnegative because it can be interpreted as the appropri- 
ately signed area between each function fi(yi) and Fu t/,. Also, 

V S l = (u- Fiy) T Ny 

< (u — Fiy) T Ny + (u — Fiy) T (F 2 — Fi ) 1 (F 2 y — u) , 

= —T3(,y,v)- (3.26) 
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With these results, we present the following: 

Theorem 3.2. Consider an LTI system G(s) coupled to m independent nonlin- 
ear functions that satisfy the sector constraint Fu y\ < fi(yi) yi < F 2 i yf. If there 
exists a multiplier W(s) = (7 m + Ns) with N € N and a matrix R = R T > 0 6 R nXn 
such that 

(i) Ro i [(P d + NC 0 Bo) + (F d + NC 0 Bo) t ] > 0, and 

(ii) there exists a symmetric P > 0 that satisfies 

0 = (A - B q F 1 Co) t P + P(A - B 0 F 1 Co ) + R + [C 0 + NC 0 (A - B 0 F 1 C 0 ) - B*p\ T 
Ro 1 [Co + NC 0 (A - BoF^Co) - B*P\ , (3.27) 

then the negative feedback interconnection of system G(s) and the nonlinearities /»(•), 
i = 1 is asymptotically stable. In this case , a Lyapunov function for the 

combined system is given by 

m fCoix 

V = x T Px + 2 ^2 n u I — Fuc) dc (3.28) 

i = i Jo 

where Ccn corresponds to the ft 1 row of Co. 

Proof: The proof of this theorem is exactly analogous to the one developed for 
Theorem 3.1. The difference in this case is that we must use the modified state space 
representation of G and the supply rate in Eq. 3.22. □ 

As expected, the results of Theorem 3.1 are recovered for the case F\ = 0. Since 
the symmetric case is of particular importance in later developments, we present the 
following corollary: 

Corollary 3.1. If the nonlinear functions in Theorem 3.2 satisfy the constraint 
—Fiyf < fi(yi)yi < Fiyf, and there exists a multiplier W(s) = (J m + Ns) with N eN 
and a matrix R = R? >0 £ R nXn such that 

(i) Roa = [i^- 1 + NC 0 B 0 + (jV<7 0 £ 0 ) r ] > 0, and 

(ii) there exists a symmetric P > 0 that satisfies 
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0 = (.A -f- BqFCq^ P + P(.A + BqFCq) + R + Co + NCo{A + BqFCq') — Pj'pj 

Rol [Co + NC 0 (A + BoFCo) - P 0 T P] , (3-29) 

then the negative feedback interconnection of system G(s) and the nonlinearities /»(•), 
i = 1 , . . . ,m is asymptotically stable. 

Section 3.6 considers sufficient conditions in the frequency domain for the exis- 
tence of positive definite solutions to the equations in Corollary 3.1 and Theorems 3.1 
and 3.2. The results of Theorem 3.2 and Corollary 3.1 demonstrate the unified frame- 
work of Riccati equation and Lyapunov function tests for system stability. The free 
parameters in these tests are the sector bounds F\ and Fz and the multiplier values 
N. It is difficult to gain insight into their roles in these state space tests, but the 
following section demonstrates their function in a frequency domain test. 

3.4 Frequency Domain Stability Conditions 

The utility of absolute stability criteria such as the one from Popov [131] is the sim- 
plicity of their graphical interpretation in the frequency domain. The previous section 
developed state space conditions for the stability of an LTI system G(s) coupled with 
two main classes of nonlinear functions. While recent trends in control theory are 
towards time domain or state space Riccati-based tests, one advantage of these fre- 
quency domain criteria is the insight that they provide into the role of the frequency 
domain multipliers. Lemma 3.1 provides a powerful tool for converting from state 
space to frequency domain stability conditions within the storage function framework. 

Lemma 3.1. (Trentelman and Willems [159]). Consider an LTI system y = 
— Gu with supply rate r(y,uf Define a system z = — Hu , z £ with state space 

and supply rate r(z,u) = z T Lz, where 

L = L t G R( m+I )x( m +0 andf(z,u) = r(y,u). If Ah has no poles on the jw-axis, then 
the following statements are equivalent: 

(i) the system H(s) is dissipative with respect to the quadratic supply rate r(z,u); 

(ii) H*(jco)LH(jlo) > 0, 6 R. 


representation H(s) 
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Proof. See Ref. [159]. □ 

The system H(s ) represents a modification of the system G(s) to provide functions 
of both the inputs — u and outputs y = — Gu in the output vector z. Consider the 
simple example of the supply rate r(z,u ) = —u T y, where 




and L = 



(3.30) 


The frequency domain test for dissipativity is then 


H\]u)LH(j w) = G*(ju) + G(ju) >0, we R, (3.31) 

which, along with the condition that G(s ) be asymptotically stable, is the standard 
matrix positive real test for the system G(s). Note that similar statements can also 
be developed for the strongly dissipative conditions. 

Thus Lemma 3.1 provides a tool for transforming the state space stability criteria 
given in the previous sections into equivalent frequency domain stability criteria. 
Furthermore, while these tests are interesting in terms of the extra interpretation 
that they provide for the multipliers, they also provide conditions for the existence 
of the positive definite matrices P in Theorems 3.1 and 3.2. 

As with the standard Popov test, it is generally possible to interpret the frequency 
domain criteria as modified Nyquist tests that describe admissible regions of the 
complex s-plane for the plant transfer function. The goal here is to interpret these 
tests to develop insights, such as those in Fig. 1.3, towards the aim of modelling real 
parameter uncertainties. 

For the sector-bounded constraints on the nonlinearity, the supply rate of Eq. 3.24 
can be written as a function of the inputs — u and outputs y of the system G. For 
complicated forms of the supply rate, it is useful to introduce the following notation. 
Let 

z = T(s) V =T(s) ^ (-u) (3.32) 

u Im 

where T(s ) is a 2m x 2m matrix relating the inputs and outputs to the terms in the 
supply rate. For simple forms of the supply rate, such as r — —u T y, we have T = I^m- 
However, this more general form also allows us to incorporate the multiplier W(s) 
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and other input-output scaling terms. In particular, using rz{y,u) in Eq. 3.23, we 
define T gen (s) for the general sector problem as 


T gcn (s) 


W(s) + F d F 1 F d 

F, Im 


(3.33) 


With L fixed and of the form given in Eq. 3.30, the test for dissipativity of the system 
with respect to this supply rate is 





i 

o 

r* 

i 


' G 

o < 

G * Im 

T* 

gen 

Im 0 

T 

■* gen 

Im 


\/s=jlu^\(A-BF 1 C) 


(3.34) 


or, 

r \F 1 (W + W*) + 2F 1 F d F l W* + 2F d F 1 

W + 2F d F 1 2 F d 

As before, we concentrate on the symmetric sector case where —Fi = F = i^. Since 
W{]uj) = I m + Njuj and 2 F d F\ = — J m , then W + 2F d F\ = Nju>. Furthermore, we have 
W + W* = 2I m and 2F 1 F d Fi = F, which imply that Fi(W + W*) + 2FiF d F 1 — —F. 
With these simplifications, the condition in Eq. 3.35 can be rewritten as 


(3.35) 


0 < -G*FG - G*(Nju) + (Njuj)G + E" 1 
= -G*FG + (ju)(NG - G*N) + F' 1 (3.36) 

= - {(<? + ju}NF~ 1 )*F(G + jljNF- 1 ) - ^tfF- 1 - F" 1 } (3.37) 

Rearranging for ease of interpretation, the stability condition is whether there exists 
an N > 0 such that 


(G + juNF~ 1 )*F(G + jloNF- 1 ) < F -1 (7 m + u> 2 N 2 ) (3.38) 


for all ui. 

To continue with the geometric interpretation of these extended tests, we consider 
the original formulation of Popov [131]. Consider a single nonlinear function with 
sector bounds (0, h ). The elements of the stability criterion with the multiplier W(s) = 
(1 + /3s) are shown in Fig. 3.5. The test is performed in a modified Nyquist domain 
(Re(G), a»Im(G)), commonly referred to as the Popov plane. In the figure, the stability 
bound is a single straight line with slope governed by 1//3 and real-axis intercept at 
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-1/h. The system is stable if there exist /3 and h such that the plot of the system 
transfer function in the Popov plane lies to the right of this line [123]. For a given 
multiplier coefficient /3, there is an optimal value of h where the stability bound 
just touches the plot of G(s). Collins et al. [39] have developed numerical techniques 
for this optimal analysis problem. Further discussions of this issue are presented in 
Section 3.7. 

In the scalar case, the condition in Eq. 3.38 can be rewritten as 

\\G(ju>) + jujNF-'WI < F~ 2 ( 1 + WV). (3.39) 

With G = x + jy , we obtain 

x 2 + (y + loNF- 1 ) 2 < F~ 2 { 1 + NW) 

= (NF~ 1 uj) 2 + {F- 1 ) 2 (3.40) 

which leads directly to an interpretation in terms of frequency dependent off-axis 
circles. As illustrated in Fig. 3.6, the test is equivalent to requiring that, at each 
frequency oj a , the transfer function for the system G(ju> a ) lie within a circle centered 
on the jw-axis at — NF -1 w 0 . As will be seen, an important feature of these circles is 
that each one intersects the real axis at iF 1-1 . 

The stability condition in Eq. 3.40 is similar to the ones considered by several au- 
thors. Hsu and Meyer [86] develop a similar result in their analysis of exact frequency 
domain criteria with a single, sector-bounded nonlinearity. A frequency dependent 
“circle” condition is also developed by Zames and Falb [174] using operator theory 
techniques. They did not consider the same case presented here, so the geometric in- 
terpretation is not as clear. Cho and Narendra [35] consider an over bounding off-axis 
circle test, but the key difference is that the test in Eq. 3.40 is frequency dependent. 
Bergen, Narendra, and Taylor [16, 123] simplify the problem by specializing to the 
case in which the elements of F\ and Fz have the same sign. The advantage of this 
assumption is that quadratic terms can be deleted from the stability constraint, which 
leads to a much simpler geometric interpretation of the condition. The result is that 
the straight line stability bound in the Popov test is replaced with a parabola. Then, 
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Figure 3.5: Standard Popov test in the modified frequency plane. 

as before, only one fixed stability bound is used in tbe Popov plane. Unfortunately, 
in tbe symmetric sector case considered here, Pi and F 2 Have opposite signs, so tbis 
simplification is not applicable. 

For a given sector bound, tbe remaining free parameter in tbe test is N. Tbis 
value governs tbe multiplier phase, and from Eq. 3.40, determines tbe location of tbe 
circle centers as a function of frequency. It is tbe bound in Eq. 3.39 and tbe geometric 
interpretation that lead to some important conclusions in Section 3.7 about tbe upper 
bounds for real fi . With tbis new insight into tbe role of tbe matrix N, we make the 
following observation: 

Remark 3.1. If N = 0, the center of tbe circle is at tbe origin for all frequencies. 
In tbis case, tbe frequency domain test is equivalent to tbe small gain theorem [44]. 
In tbe state space tests we can substitute N = 0 into condition (i) of Corollary 3.1 to 
obtain = F. A similar substitution into Eq. 3.29 yields 

0 = (A + BoFCofP + P{A + B 0 FC 0 ) + R + [C Q - B%pf F [c 0 -B%P). (3.41) 

On expanding, Eq. 3.41 becomes 

0 = A T P + PA + R + (%FCo + PB 0 FB*P + 

CqFBqP + PB 0 FC 0 - PBoFCo - C 0 T FB* P, (3.42) 

which, after canceling tbe last four terms, yields 

0 = A t P + PA + R + CfFCo + PBoFB^P. (3.43) 
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Figure 3.6: Examples of off-axis circle constraints for the symmetric sector 
Popov test at two frequencies with centers at (7; governed by u; a . 
Each circle intersects the real axis at ±4:. 

r 

Since the elements of F just scale the system inputs and outputs, Eq. 3.43 is identical 
to the standard Riccati equation for the small gain test. □ 

We can now discuss these stability criteria in terms of the goal of performing 
stability analysis for a system with real parameter errors. It was shown in the Intro- 
duction that the linearized form of the Lyapunov functions in Eqs. 3.6 and 3.28 are 
parameter-dependent. These restrict the allowable time-variation of the uncertainty, 
thus incorporating more phase information about the system parameter errors. The 
geometric interpretation of frequency dependent off-axis circles can be related to other 
approaches for the system uncertainty. Consider the real parameter uncertainties in 
Fig. 1.3a scaled to lie between ±1. With F = 1, all of the off-axis circles include 
this region of the real-axis. A further property of the test is that the center of the 
constraint circle is near the origin at low frequencies. However, at higher frequencies, 
when the circle center is far from the origin, the constraint circle is very large. In the 
limit, they fill the entire semi-plane. Consequently, the off-axis circle test is similar to 
a frequency blended combination of the small gain and positive real stability criteria. 

The off-axis circle test in Fig. 3.6 corresponds to the bounds on the system G(s), 
but a similar set exists for the uncertainty block. As suggested by the previous 
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discussion, a key feature of these circles is that, because the location of the circle 
center changes as a function of frequency, the phase of the uncertainty is restricted. 
As a result, the difference between real and complex numbers can be distinguished 
in the robustness test. As discussed in the Introduction, this distinction is crucial 
for developing less conservative robustness tests for problems with real parameter 
uncertainties. 

In this section, it was demonstrated that the phase of the stability multiplier plays 
a crucial role in determining the location of the circle center in the frequency domain 
tests. The phase of the Popov multiplier increases monotonically from 0° to 90° and 
thus provides few degrees of freedom in the stability tests. The next three sections 
consider stability tests with more general representations of the stability multipliers. 
These results will allow us to extend the observations in this section and conclude the 
discussion on the applicability of this approach to the stability problem with constant 
real parameter uncertainties. 

3.5 Stability Robustness for Extended Nonlinear Functions 

The previous sections considered the state space and frequency domain stability tests 
with sector-bounded nonlinear functions. These analysis results can be extended 
by including the more specific classes of monotonic and odd monotonic nonlinear 
functions. These additional tests can be used to provide less conservative stability 
criteria for certain types of nonlinear parameter uncertainties. Furthermore, with 
these additional developments, the robustness tests developed in the following sections 
will cover the continuum of real parameter uncertainties from time-invariant sector- 
bounded nonlinear functions to constant bounded linear functions. 

The results in the following sections will build on the simpler problem developed in 
the earlier sections of this chapter. . The key difference in this case is that the multiplier 
has additional dynamics that must be augmented to the model of the system. 

It is much simpler in this case to consider the supply rates and storage functions 
for each input-output pair (xt;, 3/*) of the system G(s) separately. Then, as in Corol- 
lary 2.1, the condition that the storage function for the linear system be dissipative 
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with respect to the combined supply rates for the nonlinear systems yields the sta- 
bility criterion for the interconnected system. This criterion can be interpreted as 
requiring the existence of a positive definite solution of an algebraic Riccati equation. 
Furthermore, combining the storage functions for the linear and nonlinear systems 
provides a parameter-dependent Lyapunov function for the interconnected system. 

Popov [131] introduced a multiplier for sector-bounded time-invariant nonlinear 
functions. Several authors have discussed the appropriate multipliers for monotonic 
and odd monotonic restrictions on the nonlinear functions. Specifically, Narendra 
and Taylor [123], Brockett and Willems [28,29], Narendra and Cho [120], Zames and 
Falb [174], and Thathachar and Srinath [158, 156] have developed suitable stabil- 
ity multipliers W(s) for monotonic and odd. monotonic nonlineax functions. These 
multipliers are given by the functions in the sets Wrl and Wrc, which exhibit an 
interlacing pole-zero pattern on the negative real axis. The two sets are distinguished 
by which is closest to the origin, a pole (Wrc) or a zero (Wrl) [61]. The standard 
form of the multiplier for each i = 1, ... ,m is 


Wi(s) — a,'o + fins 

mu 

+ £ OCij 
3 = 1 


1 

AiO + Tjij) J 


m; 2 

+ £ a V 

j=mn+l 



a ij \ 

+ va)J 


(3.44) 


where the coefficients a^-, fcj, and rjij are nonnegative and satisfy rjijfiij — a ij > 0. 
To consider just monotonic nonlinearities, take m; 2 = mu in Eq. 3.44 (i.e., eliminate 
the last summation). For odd monotonic nonlinearities, it is also possible to include 
multipliers with terms that explicitly contain complex poles and zeroes. While the 
extra freedom associated with this extension will be discussed later, one can develop 
very general forms of the multiplier Wi(s) with the three main components of Eq. 3.44. 

The frequency domain criteria in the previous sections demonstrate that the mul- 
tiplier phase plays a crucial role in determining the conservativeness of the analysis 
test. The first two terms of Eq. 3.44 correspond to the standard Popov multiplier 
whose phase angle increases monotonically from 0° and 90°. The first sum in Eq. 3.44 
is a partial fraction expansion of the driving point impedance of a resistor-inductor 
(RL) network. While the phase for this class also lies between 0° to 90°, it is not a 
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monotonically increasing function of frequency. The last summation in Eq. 3.44 is of 
the form of a driving point impedance of a resistor-capacitor (RC) network, with a 
pole closest to the origin, and phase between 0° and —90°. 

As illustrated in Fig. 3.2, proving stability of the coupled system requires handling 
signals of the form W(s)y. While obtaining filtered outputs of this form is simple 
for the Popov multiplier, it is quite complicated for the multipliers in Eq. 3.44. In 
particular, with these extended multipliers, it is necessary to augment the multiplier 
dynamics to the original system so that the filtered outputs can be obtained directly 
from the augmented state vector. The resulting augmented matrix A a then contains 
the poles of both the system G(s) and the multipliers Wi(s), i = 1, . . . ,m. 

While much of absolute stability theory has been developed for infinite sector or 
slope restrictions on the nonlinearity, the shifting approach discussed in Section 3.2 
has been used to handle finite bounds [44,133]. Define Mi, M 2 6 R mXm as diagonal 
matrices whose nonzero elements represent the upper and lower sector bounds for each 
input-output loop. The transformations illustrated in Fig. 3.7 convert the general 
slope restrictions (Mi,M 2 ) to a one-sided condition (0 ,M 2 — Mi), and then finally 
to an infinite one (0, 00 ). For now, we consider only the bounds (0, M 2 ), and a later 
remark will consider the more general case. The following section outlines the process 
for shifting these sectors and augmenting the multiplier dynamics. Sections 3.5.2 
and 3.5.3 contain the stability tests for systems coupled with monotonic and odd 
monotonic nonlinearities. 

3.5.1 Multiplier augmentation 

We begin with a discussion of the transformations illustrated in Fig. 3.7. In the 
following, take M x = 0 and M 2 = M = diag(Mu, . . . , M mm ), and consider differen- 
tiable monotonic and odd monotonic nonlinear functions that satisfy the constraint 
< Mu for all values of a. Note that this constraint implies that fi{cr) satisfies 

do- “ 

the sector constraint 0 < crfi(cr) < Mua 2 . From the figure, observe that f(y) = f(y), 
/( 0) = 0, and 

y = y - M _1 /(jf). (3.45) 
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Desoer and Vidyasagar [44] present a discussion of the existence and uniqueness of 
the solution of this equation. While these issues dominate the discussion for arbitrary 
nonlinearities, it is known from [156] that these properties are automatically satis- 
fied for sector-bounded monotonic nonlinearities. Furthermore, for each nonlinearity 
with yi ^ 0, define 


fijyi) _ fi(yi)/yi 

& l - 


(3.46) 


If /*(•) is sector-bounded by Mu, then the equivalent condition for the shifted nonlin- 
earity is yifi(yi) > 0. Also, by the chain rule, 


d/i(yi)/dyi 


dyi 1 - M^df^y^/dyi ’ ^ 3 ‘ 47 ^ 

so that if /{(•) is differentiable and satisfies the slope restrictions 0 < < Mu, 

then /»(•) is also differentiable and satisfies 0 < and thus is monotonic. The 

same transformation can be used for slope restricted odd monotonic nonlinearities. 

The corresponding changes to the LTI system are also illustrated in Fig. 3.7. In 
particular, for Mi = 0, the shifted system is given by 


G(s) = G(s) + M-\ 


(3.48) 


with inputs —u, and outputs y. Each transformed nonlinearity /,•(•) is restricted to 
lie in the first and third quadrants, so that 


VctGR. (3.49) 

Furthermore, because the transformed nonlinearities are monotonic, they satisfy 

0 < (/i(o-i) - /i(o- 2 ))(ai - cr 2 ), Vci,<7 2 eR. (3.50) 

With these transformations, we can now proceed with the multiplier augmenta- 
tion. An approach similar to the one in Fig. 3.2 (with G(s), /(•) replaced by G(s), 
/(•)) is used to develop the stability tests. The supply rate in this case is a function 
of the new output (equivalent to y in Fig. 3.2), which is obtained by applying the 
appropriate multiplier to each element of the output of G(.s). Observing the form of 
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I -J 


Figure 3.7: System transformations and the definitions of G, /(•), u, 
and y. If the lower slope bound Mi = 0, then /(•) = /(•), 
G(s ) = G(s), and u = u. 


the multiplier in Eq. 3.44, it can be seen that in the expression Wi(-s)jft, there are 
terms of the form 

*,• = - ^ -■ (3.51) 


,J Pij{* + Vij) ' 

Hence, the corresponding supply rate will involve real signals z*,- obtained by passing 
the system output jji through a parallel bank of decoupled low pass filters with time 
constants 1/rjij and positive gains For the system as in Eqs. 2.19 and 2.20, 

formed from W“ 1 (s) and fi(-), with Zij as the system states, the dynamics of each 
term in the multiplier can be augmented to the system by rewriting Eq. 3.51 as 


Zij + Vij z ij = jryi = 7T (Ct>* - M 1 uj . , 


(3.52) 


Ai Pa 

where (•); denotes to the i th row of (•). Writing the states in a vector zf = [zn , . . . , z; mi2 ], 
the dynamics associated with each multiplier W»(s) can be written as 



X 

[Ci Ai] 

Zi 


— MjU. 


(3.53) 
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(3.54) 


In Eq. 3.53, A; = diag (— j = 1, . . . ,m; 2 , and 



“h. 


SiL 



A’i 

Si2. 


“iZ 

Pi2 

<n 

• H 

g 


aim i7 


“im;. 

- 2 - 


- 2 - 


where (Co)» and (M x )i denote the 


rows of the respective matrices. 


With m input-output pairs to the system G(s), the multiplier dynamics can be 
augmented to the shifted system G(s) to obtain a state space representation of G a (s) 
given by 


2>a — AqXq BqII) (3.55) 

y = C a x a — M -1 u, (3.56) 


m 

where n a =n + 2 , and x a £ R n “, A a , B a , and C a are defined as 

»=i 



X 


'a 0 0 •• 

• 0 


' Bo ‘ 


z\ 


G x 0 

0 


Mi 

x a = 

z 2 

II 

0 

C 2 0 A 2 

0 

F 

II 

m 2 


Zm 


c m 0 0 

A m 


Mm. 


II 

O 8 

o 

o 

o 




(3.57) 


Next, define Rij as an output matrix for this augmented system, designed to access 
the j?'** 1 element of z,-, so that 


Zij = RijX a . (3.58) 

»-i 

Then the only nonzero element of Rij is the (^m/ 2 + j)^ term, which is unity. 

Note that, although extra dynamics associated with the multipliers have been 
added to the system G a (s), it can easily be shown that 

Ga(s) = C a (sl - A a )-'B a + M- 1 = Co{sI - A)~ l B 0 + AT 1 = G(s). (3.59) 


Hence, by pole-zero cancellation in each input-output loop, the frequency domain 
representations of G(s) and G a (s) are equivalent in terms of their input-output prop- 
erties. The following simple example is used to clarify the preceding notational de- 
velopment. 
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Example 3.1. Consider a LTI system with realization 



0 1 

O' 

Cr(s) ~ 

-1 -2 

1 


. Ci c 2 

0. 


(3.60) 


0-2 




(3.61) 


where M = 1, and the multiplier given by 

VF(s) = ai(l ) + a 2 (l . 

s + Tj! 5 + 772 

Let zi, z 2 be the states corresponding to the multiplier dynamics. Then the augmented 

system is given by 


(3.62) 



Xi 


0 

1 

0 

0 


' 0 ' 


x 2 


-1 

-2 

0 

0 

, B a = 

1 
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, A a — 




0 



Z\ 

Oil Cl 

CLIC 2 
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. CL 2 Ci 
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-772 


. °L 2 . 


C a = 


ci c 2 0 0 , R 11 = 


0 0 10 


j R12 — 


0 0 0 1 


Since 




where 


i(s) = 


Cti 


s + rji 


(si - A)- 1 0 0 

c 'i( s ) (s + Vi)" 1 0 

4(5) 0 (5 + TJ2)- 1 


ci c 2 (si — A) , i = 1,2 


it follows that C a (sl - A a ) _1 B a = C 0 (sl - A) 1 B 0 . Furthermore, 

' (si - A)- 1 0 0 

Rn(sl - AaY'Ba =[ 0010 ] di (s) (s + TJi)" 1 0 

L <i( s ) 0 (5 + 77 a )- 1 

" B 

= [400 (s + yiY 1 0 


ct 1 
0-2 


CL 1 


5 + 72i 




(3.63) 


(3.64) 


(3.65) 



' B ' 


CLl 


_CL 2 . 


(3.66) 

(3.67) 


and similarly for i?i 2 . 
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From Corollary 2.1, it is known that, in the development of the storage functions 
and supply rates, each input-output pair of G(s) can be considered independently. 
Hence, without loss of generality, the following develops the supply rates and storage 
functions for the separate single-input single-output nonlinearities coupled with the 
appropriate multiplier. Since the goal is to demonstrate that the combination of 
the nonlinear function and the multiplier, as in Fig. 3.2, is passive, it follows from 
Section 2.3 that an appropriate supply rate is a product of the system inputs and 
outputs. A modification of this supply rate is required for the multipliers in Eq. 3.44 if 
M/ 0. In this case, with s denoting the standard Laplace variable and yi = Wi(s)yi, 
we consider signals of the form 

Vi = Wi(-s)jft + PioM^sui. (3.68) 

It will be seen that this additional term is equivalent to the quadratic term in Ref. [123] 
that is added to the Lur’e-Postnikov Lyapunov function to account for a direct trans- 
mission in the plant dynamics. As will also be shown in the following development, 
the term su t - is used to cancel an equivalent term from the Popov multiplier in the 
expression y t - = The assumed differentiability of the shifted nonlinearities 

guarantees that the expression in Eq. 3.68 exists. 

3.5.2 Monotonic nonlinear functions 

In this section we develop the supply rates and storage functions for monotonic non- 
linearities {nii 2 = mu), and present robust stability conditions for the full system via 
algebraic Riccati equations. Using the definitions of kPi(s) in Eq. 3.44, y in Eq. 3.45, 
and the filtered outputs in Eq. 3.51, the signal in Eq. 3.68 becomes 

Vi = Yl “ ' /3.^ + v ..y & + ( ai0 + &o s )(y - + PioM^sui 

rail 

= ViAi/i - Z a) + (“a + Pios)yi - CCioM^Ui 

i=i 

rail 

= ^2 - Zij) + Piasyi + ctioyi- (3.69) 

j=i 
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We then construct the supply rate ri(y i} Ui) in terms of the time domain representation 
of y i and u,-, to obtain 


nfa, Ui) = 


mil 


X] a ij(yi - z a) + Pioiu + a ioVi 
i=i 


Ui. 


(3.70) 


An appropriate storage function for this supply rate is given in the following lemma. 


Lemma 3.2. Consider a differentiable monotonic nonlinear function /;(•) that 
satisfies the slope restrictions 0 < < Mu. As in Eq. 3.f6, define the differentiable 

monotonic nonlinearity fc(-) that satisfies Eqs. 3.49 and 3.50. Consider the dynamic 
system Qi that is a combination of fi(-) and Wi _1 (s) from Eq. 3-44 ( m i 2 = m,i ), 
with corresponding state space representation given by Eqs. 2.19 and 2.20. Then the 
function Vu defined by 

a y { _ 1 \ m ’ 1 fZij _ 

fi(a)da, (3.71) 

is a storage function for the supply rate in Eq. 3.70. 


Proof. Since iz t - = fi(yi), and the dynamics of Qi can be written in terms of 
yi and Zi, V,;(-) is a function of the states of the dynamic system. Also, because 
/( 0) = 0, it follows that V 4 i(0) = 0. From Eq. 3.49, because fy, j = 0,1,..., mu 
are nonnegative, then Vu is nonnegative definite. Finally, to show that Eq. 3.71 is a 
storage function, it must be demonstrated that it is dissipative with respect to the 
supply rate of Eq. 3.70. 

For notational convenience, let Uij = fi(zij) and Ui = fi(yi). Now, dropping the 
arguments for convenience, 


mil 


— y ] QijUijZij + ffo 
j=l 


- ,, r _ i dttj 

y i + M H d t 


Ui. 


(3.72) 


From the definition of y in Eq. 3.45, terms of the form ^ cancel. Next, note that 
Eqs. 3.49 and 3.50 yield 


0 < ouoyiUi, 

0 ^ &ij (Jji Zij)(y,i Uij), 

0 ^ {Vijfiij ~ ) z ij u ij ) 
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(3.73) 

(3.74) 

(3.75) 


for j — 1, . . . , mu. Adding Eqs. 3.73, 3.74, and 3.75 to Eq. 3.72 yields 


. m ii mil 

— Y^ u ij ( A ~j Pij —cxjj) Zjj ) -f- Y. Qii-j(yj— Zij)(ui—un)-}-( 0io'iii-{-ainv')u; . (3.76) 

j = i j=i 

Collecting terms yields 


rail 

— y 'j [fiijZij (jlijPij °Lij(yi z i j)] u ij 

3=1 

Ui. (3.77) 

Now, it follows from Eq. 3.51 that 


+ 


rail 


Y <*3 (Vi ~ Z ij) + Mi + OiOVi 


3=1 




(3.78) 


so that the first summation of Eq. 3.77 is zero, and using Eq. 3.70 yields 

rail 

Vn < Y a ij(yi ~ Z ij) U i + {Mi + OiOVi)^ = (3.79) 

3=1 


which demonstrates that the storage function is dissipative with respect to the supply 
rate. □ 

Note that the state space representation for Qi is in terms of the states y t - and 
Zi which, because of the augmentation process discussed in the previous section, can 
easily be written in terms of x a . While it is convenient to consider the supply rates 
and storage functions for each nonlinear function, these must be combined to form the 
supply rate for the linear system G(s) and the full multiplier W(s). Vector notation 
will simplify this development, but we must first define the following matrices. These 
definitions are complicated by the fact that each W»(s) can have a different number 
of expansion terms in Eq. 3.44. This difficulty can be handled by defining extended 
values of ctij, (3ij, and rjij. Let mi = max^m^). Then, for each i = l,...,m, and 


j — 1, . . . , mi, let ctij — 0, Pij = 0, T) ij = 0, and Rij = 0 if j > mu. Furthermore, 
define Hj = diag(a iy , . . . , aw,), N d = diag(/3 il , . . . ,/5 jm ), Sj = d^g( Vjl , . . . 
j = 0, 1, ... , m x . Finally, let Rj = R^, . . . , T . Then as in Corollary 2.1, 

using Eq. 3.70 to form the overall supply rate for the LTI system G(s) yields 


m 


R(y,u) = Y r i(yn u i) 

»=i 


(3.80) 
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Ul ••• U n 


mu 


V. a ij(yi ~ z ij) + Pioiii + “ ioz/i 

i= i 


(3.81) 


771 ml 


&Tnj(jJm z mj ) "I" fimoi/m “H ^m02/n 

L j=i 


= u 


mi 


^ Hj(y - Zj ) + N 0 y + H 0 y 

i=i 


(3.82) 


where % = [ 2 ^- • • • z m j ] T . This representation of R(-, ■) can be simplified further by- 
using the definition of Rj to note that for each j, Zj = RjX a . 

Furthermore, using Eq. 3.45 for y, and noting that y = C a x a = C a (A a x a — B a u ), 
the overall supply rate can then be written as 

m 1 rai 

R(y, u) = u T [HoC a + N 0 C a A a + Hj{C a — Rj)]x a — u T [NoC a B a + HjM )u. 

j=i 3 = 0 

(3.83) 

The stability condition for the interconnected system can now be presented using the 
overall supply rate. 


Theorem 3.3. Consider an LTI system G(s) coupled to m independent, differ- 
entiable monotonic nonlinearities that satisfy the slope restrictions 0 < < Mu . 

If for each input-output pair {u^yf), there exist multipliers Wi(s) as in Eq. 3-44 an d 
a matrix R = R T > 0 € R naXTla such that with the preceding definitions of Hj, Nj, 

CLTld j 


(i) *0 = 


mi 


mi 


{N 0 C a B a + £ HjM- 1 ) + ( N 0 C a B a + £ HjM^f 1 

3= 0 3= 0 


> 0, and 


(ii) there exists a symmetric matrix P > 0, satisfying 


0 = A^P + PA a + R+ [H 0 C a + N 0 C a A a + Y,H j (C a - Rj) - BjPffR^ 1 

i - 1 

mi 

[H 0 C a + N 0 C a A a + Y,H j (C a - Rj) - BjP], (3.84) 
3 = 1 

then the negative feedback interconnection of the system G(s) and the nonlinearities 
fi(-), i— 1 ,mis asymptotically stable. Furthermore, a Lyapunov function for the 
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combined system is given by 


V(x a ) = x T a Px 


M *1 \ fZ" 

+ 2 Yj Pto (J fi(<r)dtr + / * fi{<?)dcr 

i=i Vo l J j=1 Jo 


. (3.85) 


Proof. The proof of this theorem is very similar to the one for Theorem 3.1. In 
this case we use the storage function 

VG{x a ) = ^x*Px a . ( 3 . 86 ) 

Note that Eq. 3.71 gives a storage function for each input-output pair ( U{,yi ) that 
is dissipative with respect to a given supply rate. For asymptotic stability of the 
interconnected system, it must be demonstrated that the positive definite function 
Vg is strongly dissipative with respect to the negative sum of these supply rates. 
Clearly, if P is a positive definite matrix, then Vg is a positive definite function. 
Next, from Eqs. 2.17 and 3.83, we require that 

V G (x a (i)) < -R(y,u). (3.87) 

Following the procedure in the proof of Theorem 3.1, r(x a , u) is formed and ~^ u ' 1 = 
0 is solved for u w . To prove that the system is dissipative, it is sufficient to guarantee 
that the worst case input results in a negative maximum of T(x a ,'U u> ). Thus, select 
R = R T > 0, and require that max u r(x a ,u) = ~^x^Rx a < 0. Substituting for u w 
into r(s a ,u) yields the condition that P of Eq. 3.86 satisfy 

mi 

A T a P + PA a + [H 0 C a + N 0 C a A a + £ Hj(C a - R-) - BjPfR- 1 

3 = 1 

mi 

[HoC a + N 0 C a A a + £ Hj{C a - Rj) - B%P] = -R < 0, (3.88) 

i=i 

which is equivalent to Eq. 3.84. Hence, it follows from Corollary 2.1 that the Lyapunov 
function for the combined system is 

m 

y = 2 Vg + 2 Y,Vsi. (3.89) 

»=i 

Substituting the definitions of these storage functions from Eqs. 3.71 and 3.86 yields 
Eq. 3.85. □ 
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Remark 3.2. V{x a ) in Eq. 3.85 is an extended Lur’e-Postnikov Lyapunov func- 
tion because it depends explicitly on the nonlinearity Similarly, in the linear 

uncertainty case, where = Fijji, V(x a ) becomes a parameter- dependent Lya- 

punov function because the uncertain parameters Fi explicitly appear in the Lyapunov 
function. In this case, as discussed in the Introduction, the uncertain parameters are 
not allowed to be arbitrarily time-varying, and the result is a refined framework for 
constant real parameter uncertainty. O 

3.5.3 Odd monotonic nonlinear functions 


We now consider odd monotonic nonlinear functions. The procedure is identical 
to the one discussed in the previous section, the main difference now being that 
the transformed nonlinear function /(•) satisfies Eqs. 3.49, 3.50, and an additional 
constraint, from Ref. [122,123,156,158] 

0 < 01 /( 01 ) + 0- 2 /(02) + o-i/M - 02/(0i), V 01 , o- 2 € R. (3.90) 


The definition of the supply rate and multiplier augmentation process are as discussed 
in Sections 3.5.1 and 3.5.2. In this case, we consider ma > mu in Wi(s) of Eq. 3.44. 

Using the simplification of r^y^m) in Eq. 3.70, the definition of in Eq. 3.51, 
and noting the form of the multiplier terms in Wi(s) for j = mu + 1, . . . ,mi 2 , the 
supply rate can be rewritten as 




mil 


m{2 


^ ] Clijiyi Zij') 4* ^ ] ay(yi 4* Z{j ) 4" PioVi 4" &ioyi 

j = 1 j =m il +1 


Ui. 


(3.91) 


A storage function for this supply rate is given in the following lemma. 


Lemma 3.3. Consider a differentiable odd monotonic nonlinear function fi{ % ) 
that satisfies the slope restrictions 0 < < Mu. As in Eq. S. 46 , define the differ- 

entiable odd monotonic nonlinearity fi(-) that satisfies Eqs. 3-49 and 3.90. Consider 
the dynamic system Qi that is a combination of /»(•) and the multiplier W i _1 (s) from 
Eq. 3.44 ( m i 2 > mu), with corresponding state space representation given by Eqs. 2.19 
and 2.20. Then the function Vu defined by 

a y. I \ 771^2 

7iW<fc + jJMSV) ( 3 - 92 ) 
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is a storage function for the supply rate in Eq. 3.91. 


Proof. As in the proof of Lemma 3.2, V,i is a nonnegative definite function of 
the states of the system formed by combining W~ 1 (s) with the nonlinearity fi(-) as 
in Fig. 3.2. Furthermore, using the results of Lemma 3.2, note that 


14- < 


mil 


Y a b'(& “ Z ij) + PiOVi + OiQVi 

J=1 


mi2 


+ Y Pii U ij z H- 


(3.93) 


Note that Eq. 3.90 yields 


0 < Oiij (( z i:j + yi)ui + (z^ - yi)uij ) 


(3.94) 


for j = mu + 1, . . . ,mi 2 . Next, adding Eqs. 3.73, 3.75, and 3.94 to Eq. 3.93 yields 


m,'i 


Ui 


Y - z a) + fain + a ioVi | 

J =1 
m i2 

4" ^ ) [PijUijZij -j- (PijT]ij OLij^ZijUij + CLij {fzij + jji)Ui + yi)Uij)] .(3.95) 

j— m il +1 

Next, Eq. 3.78 can be used to replace z^-, and after canceling terms, Eq. 3.95 becomes 


V* < 


mil 


m,-2 


Y «v(yi - Z a) + Y 'XijiVi + Z a) + PiaVi + a ioVi 

3 = 1 3= m U +1 


Ui. 


(3.96) 


Hence, from the definition of r;(-,-) in Eq. 3.91, it follows that V 3 i < ri(-,-), or 
equivalently, that the storage function is dissipative with respect to the supply rate. □ 
To prove overall system stability, we again form augmented matrices using m\ 
and m 2 = max,(m t - 2 ). Then, from Eqs. 3.83 and 3.91, the overall supply rate can be 
written as 


mi 


m 2 


R{y, u) = u T [H 0 C a + N 0 C a A a + £ - Rj) + Y #;( C a + R d )]x a 

j=l j=rni+l 

m 2 

-u T (N 0 C a B a + Y, HjM~ x )u. 

3=0 


(3.97) 


The following theorem governing the overall stability of the system can now be stated. 

Theorem 3.4. Consider an LTI system G(s) coupled to m independent, differen- 
tiable odd monotonic nonlinearities that satisfy the slope restrictions 0 < < Mu. 
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If i f or each input-output pair ( U{,yi ), there exist multipliers Wi(s) as in Eq. 3-44 an d 
a matrix R = R T > 0 E R n * xna such that, with the preceding definitions of Hj, Nj, 
and , 


(i) Ro £ 


m2 


m 2 


{NoCaBa + £ HjM- 1 ) + ( N 0 C a B a + £ H^f 1 

i = 0 j = 0 


> 0, and 


(ii) there exists a symmetric matrix P > 0, satisfying 


0 = A T a P + PA a + R 

mi m 2 

+ [ H 0 C a + N 0 C a A a + £ Hj(C a - Rj) + £ H 3 {C a + Rf) - B T a P] T R? 

j= 1 J=mi+1 

mi m 2 

[ H 0 O. + NoC'A' + •£ Hj(C . - Rj) + £ H,iC. + Rj) - B?P], (3.98) 

i= 1 i=mi+l 

then the negative feedback interconnection of the system G(s ) and the nonlinearities 
fi(-), i = 1, ... ,m is asymptotically stable. In this case, a Lyapunov function for the 
combined system is given by 


V(x a ) = x T a Px a 

m 

+2E 

*=1 


a y; 1 \ fZij _ 

fi{a) da + + £ Pi, J Q /i(o-) da 


. (3.99) 


Proof. The proof is similar to the one for Theorem 3.3 and is omitted. □ 


Remark 3.3. To consider nonlinearities with both upper and lower slope con- 
straints, we employ both transformations in Fig. 3.7. In particular, define /(•) and 
G(s) in Eqs. 3.46 and 3.48 in terms of /(•) and G(s), where 


Kv) = f(y) - M i y, Vy e R m 


G(s) 


(I + G(s)Mi)~ 1 G(s) ~ 


A — BoMiCo 

Bo' 

Co 

0 


(3.100) 

(3.101) 


The previous analysis can then be repeated, starting with a system G(s) and dif- 
ferentiable (odd) monotonic nonlinearities /(•) with upper slope bounds M 2 — M\. 
The appropriate Riccati equations can then be obtained from Theorems 3.3 and 3.4 
by redefining A a in Eq. 3.57, replacing u with u = u — M\y , and then substituting 


M 2 — Mi for M. 
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In the next section, we make explicit connections between the time and frequency 
domain stability conditions. The result provides sufficient conditions for the existence 
of positive definite solutions to Eqs. 3.84 and 3.98. These conditions also lead to 
explicit connections between absolute stability theory and mixed fi theory. 


3.6 Extended Frequency Domain Stability Conditions 


Following the approach in Section 3.4, we introduce a system H(s ) with outputs that 
combine to form the negative of the overall supply rate. The results from Remark 3.3 
are used to consider nonlinearities with both upper and lower slope constraints. Let 
W(s) = diag(W*(s)), and define the output vector z 


z 


H(s)(-u ) = 


'w(s) —No(M 2 - Mi) -1 s " 


y 

0 I 


—u 


W(s) 

0 


-N q (M 2 - Mi)" 1 * 
I 



(“*)■ 


(3.102) 


With the matrix L as in Eq. 3.30, it follows that the supply rate is — R(y,u ) = z T Lz. 
From Lemma 3.1, the test for dissipativeness is then whether > 0 Vo;. 

Substituting the definition of H(s ) into this condition (noting that N 0 , Mi, and M 2 
are diagonal) yields 


H*LH = 


<n i 


W*(juj) 0 

'o /" 

N 0 (M 2 - Mi )-V I 

I 0 


V( ju) -N 0 (M 2 - Ml)- 1 jcj' 


'Ga 

0 I 


I 


G* I 

W*(ju) 0 ' 

0 I ' 

'G a ' 


No(M 2 - Mi)- 1 ]^ I 

W(ju>) -No(M 2 -Mi)~ 1 juj 

I 


= G* a W* + WG a . (3.103) 

Consequently, an equivalent test for stability is that Ti(s) = W(s)G a (.s) be positive 
real. Furthermore, since it follows from Eq. 3.59 that G(s) and G a (s ) are equivalent 
in terms of their input-output properties, we need only consider the positive realness 
of T(s) = W(s)G(s). Hence, it follows that if A a is asymptotically stable and T(s) 
is strongly positive real, then there exists an n a x n„ symmetric matrix P > 0 that 
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satisfies Eq. 3.84 or Eq. 3.98, depending on the form of the multiplier W(s). Con- 
versely, for a given selection of W(s), if there exists a P > 0 for all R > 0, then A a 
is asymptotically stable, and T(s ) is strongly positive real. 

In the following, we consider the case involving finite upper and lower bounds 
on the slope of the nonlinearity. In particular, it is assumed that the upper bound 
satisfies M 2 > 0 and the lower bound satisfies Mi < M 2 . In this case, because the 
double shift illustrated in Fig. 3.7 must be used, Eq. 3.48 must be replaced with 

G{s) = (J 4- GMif 1 ( I + GM 2 ) (M 2 - Mi)' 1 , (3.104) 

where it is assumed that Mi is selected so that I + GMi is invertible at all frequencies. 
To clarify the physical interpretation of the stability criterion and develop connections 
with the upper bounds for mixed fi, the symmetric bound Mi = —M 2 will be used 
in the following development. Narendra and Taylor [123] develop similar frequency 
domain tests for the case where Mi ^ —M 2 - 

Theorem 3.5. Consider the LTI system G(s ) with m independent nonlinearities 
fi{-) with appropriate sector bounds given by Mi and M 2 ■ Assume Mi = —M 2 < 0, 
and that I — G(juj)M 2 is invertible for all wgR. For each i = 1, . . . ,m, select the 
multiplier Wi(s) as in Eq. 3-44 based on the characteristics of fi(-). Furthermore , 
define W(s) = W Re (s) + jWt»(a) = diag(W t (s)). If 

G*W Rc M 2 G - 3 (WimG - G*W Ra ) - WReMf 1 < 0, (3.105) 

for all wGR, then the negative feedback interconnection of G(s) and the m nonlin- 
earities as illustrated in Fig. 2.2 is Lyapunov stable. 

Proof. With Mi — —M 2 , it can easily be demonstrated that the first two factors 
of G(s) commute. Then from Eqs. 3.103 and 3.104, the condition for stability is that 

0 <T(ju) + T*(ju}), Vw€R, (3.106) 

where 

T(s) = W(s) (/ + G(s)M 2 ) ( I - G(s)M 2 )~ 1 (2 M 2 ) _1 . (3.107) 
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Since 7 — G(s)M 2 is assumed to be invertible and M 2 is positive, an equivalent test 
can be developed by pre and post-multiplying Eq. 3.106 by (7 — G(ju>)M 2 )* M 2 and 
M2(7 — G(]uj)M 2 ) respectively. Performing this operation, and substituting for T(s) 
from Eq. 3.107, the condition of Eq. 3.106 is equivalent to the requirement that for 
all u> e R, 

0 < (7 - GM 2 )* M 2 W (7 + GM 2 ) + (7 + GM 2 )* W*M 2 (7 - GM 2 ) 

= M 2 (W Rc + jWjn) + M 2 (W Rc + J W ha )GM 2 - M 2 G*M 2 { Wju + jW^) 

+ M 2 (W R ' - jW^) - M 2 (W R ' - J W hn )GM 2 + M 2 G*M 2 (W Rc - jW^) 

- M 2 G*M 2 (W Re + jWj xa )GM 2 - M 2 G*M 2 (W Re - jW ha )GM 2 . (3.108) 

Collecting terms and dividing through by 2 M| yields the condition in Eq. 3.105. □ 

Remark 3.4. The stability criterion in Eq. 3.105 of Theorem 3.5 is very general, 
because it may involve a mixture of the time-invariant sector-bounded nonlinearities 
as in a Popov test, the differentiable monotonic and odd monotonic nonlinearities 
discussed in Sections 3.5.2 and 3.5.3, and the time-varying nonlinearities considered 
in a bounded gain test. □ 


Remark 3.5. As discussed in Section 3.6, Eq. 3.105 has a graphical interpre- 
tation in the scalar case. Specifically, since Wfe > 0, Eq. 3.105 can be rewritten 
as 


(<? + 1^7-T(0 + - KWH* 


Wlm ^2 


W Re 

rrr )vv Rc ivi 2 - vv Rt m 2 y ) — 

w Rc m 2 w Rc m 2 W Re M 2 m 2 

Equivalently, with G = x + jy, Eq. 3.109 can be written as 




Wjn, 


- 2 + (y + ^r) 2 <iH + i^rY- 


1_ 

Mi ' v W Re M 2 ' 


< 0. (3.109) 


(3.110) 


W Re M 2 

As in Section 3.4, this test can be interpreted in terms of circles with a frequency 
dependent center at — and constant real-axis intercepts at ± M^ 1 . □ 


The expression for the circle center in this case is significantly more complicated, 
but serves to illustrate the importance of the multiplier phase. The role of this phase 
and its relationship to the conservatism of the test are presented in the next section. 
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Remark 3.6. For odd monotonic nonlinearities, Narendra and Taylor [123] and 
Thathachar and Srinath [158,156] discuss multiplier terms that contain complex poles 
and zeroes of the form 

WiM = RHS(Eq. 3.44) + £ + + ^ (31H) 

i=m i2 +1 S Vij 

This case can be handled exactly as the other terms in the multiplier, but the proofs 
of stability are much more involved. The benefit of these additional terms is the 
rapid phase variations that they allow in the frequency domain test of Theorem 3.5. 
Of course, for linear time-invariant uncertainties, these results can be extended even 
further because the only restriction on the multiplier is that it be a positive real 
function. □ 

3.7 Connections to Mixed [i Analysis 

In order to compare the upper bounds for real fi and the frequency domain stability 
tests developed in the previous section, a brief summary of the notation in Ref. [53] 
is presented. For the system matrix G(s ) E C mXm , let m r , m c , and me ( m t = m r + 
m c + me < 771 ) define the types and number of uncertainties expected in the system. 
The positive integers k{ h = m ) then define the block structure and repetition 

of the uncertainties denoted by )C(m r ,m c ,mc) = (&i, - • • , &m r , • • • , Kn T +m c , ■ ■ • , &m t )- 
The set of allowable perturbations for the system G is then defined to be 

= {A = block diag(^7^ 1 , . . . , > • • • J > ' ' • J 

Af,..., A£ c ) : % 6 R ,6? E C, A f E C k ^,i= mr+ m c+i }. (3.112) 

Definition 3.1. (Doyle [47]). For G E C mXm , fi/c{G ) is defined as 

fi K (G) = (mjn{a msJ (A) : det ( I - AG) = 0}) , (3.113) 

where Hk(G) = 0 if no A E X/c exists such that det(7 — AG) = 0. 

The complexity inherent in the definition and computation of Hk{G) has led to ' 
the use of approximations by both upper and lower bounds. For purely complex 
uncertainties, the bounds 

p{G) < (iz(G) < <r max (G) (3.114) 
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involving the spectral radius and the maximum singular value are commonly em- 
ployed. These bounds are usually refined scaling matrices. As shown in Fig. 3.1, the 
upper bound can be refined with the frequency dependent scaling matrices D. 

As discussed in Ref. [47, 171], the scaled upper bounds are exact if m r = 0 and 
2 m c + me < 3. However, for a larger number of complex uncertainties, results from 
these papers demonstrate that the upper bounds are in error by approximately 15%. 
Furthermore, with real parameter uncertainties, the bounds in Eq. 3.114 can be arbi- 
trarily poor. Recent developments have led to new upper and lower bounds for mixed 
fi (m r ^ 0) [48,53,171]. For the upper bound, define the Hermitian scaling matrices 


V K = {block diag(D 1 , . . . , I> mr+mc , , . . . , ) : 

0 < Di = D* £ C k{Xki , 0 < di £ R}, (3.115) 

U K = {block diag(lV 1 , . . . , AT mr , 0 Jtmr+l , . . . , 0 kmt ):N i = N^e C* 54 **'}, (3.116) 


that are partitioned to be compatible with the uncertainty structure X The set of 
matrices 'Dfc includes elements for all three types of uncertainties, whereas Nk. has 
nonzero terms only in those parts corresponding to the real uncertainties. Members 
of both T>ic and Mk are frequency dependent weighting functions and are constrained 
to be Hermitian. The elements of T>k, are further constrained to be positive. Note 
that within the block definition of Eq. 3.116, the elements of the scaling matrix N 
are essentially arbitrary. 

An upper bound for mixed fi is developed by Fan et al. [53] using the generalized 
numerical range [52]. The approach develops constraints from the eigenvectors of 
the system AG (A £ X& and m r ^ 0) and combines them with standard fi upper 
bounds. The result is an improved analysis test that includes phase information about 
the real uncertainties. To compare with the analysis results in the previous section, 
it is sufficient to note the following definition. 


Definition 3.2. (Young et al. [171]). For C7(s) £ C mXm and compatible uncer- 
tainty block structure JC, define 


a» = inf 

Der> K ,N£M K 


min{a : ( G*DG + j(NG - G*N ) - aD) < 0} . (3.117) 
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It is shown in Refs. [53, 171] that a* is an upper bound for the mixed /x problem in 
the sense that /z*;((7) < ymax(0,a,). 

Remark 3.7. Consider the diagonal case where ki = 1, i = 1, . . . , m t in K. Then 
it follows from Theorem 3.5 with Wr c M 2 replaced by D, Wi^ replaced by — N, and 
Mf 2 bounded by a, that the conditions in Eq. 3.105 and Eq. 3.117 are identical. In 
the case of m r linear time-invariant and m c + me nonlinear time- varying functions, 
then the bound in Eq. 3.117 is recovered. Finally, for sector-bounded nonlinear time- 
varying functions, take W Rs > 0 and Wh n = 0 in Eq. 3.105 to recover complex /z. This 
follows in the linear case since the only restriction on VF(s) is that it be a positive 
real function, and thus W Re and Wim can be any functions in the sets V/c and Nk- 

□ 

The equivalence of these two stability criteria is even stronger if we recognize that 
the upper bound for mixed /z is related to • Then, as in Eq. 3.117, minimizing 
over a. for a particular selection of D and N functions is equivalent to determining 
the largest bound M 2 that will destabilize the system for a given multiplier selection. 
As discussed by Narendra and Taylor [123], this analysis process is, of course, one of 
the key elements of absolute stability theory. The relationships between these results 
an d concurrent work by Safonov et al. is discussed in Section 3.9. 

From these observations, it is clear that there are very strong connections between 
the symmetric sector stability criteria and the upper bounds for real /z. In particular, 
the multiplier in Eq. 3.44 represents a particular parameterization of the D and N 
scaling functions. These results also imply that the same physical interpretation of 
off-axis circles can be applied to the upper bounds derived by Fan et al. [53]. For 
instance, it is now clear why, as in Theorem 7 in Ref. [171], we can set IV = 0 if the 
system matrix G(s ) is real. In this case, the plot of (7(5) lies in a segment of the 
real axis that is contained in every circle. This observation indicates that the analysis 
tests are independent of N, and the stability bounds cannot be improved by changing 
N. 
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From these results, it is also evident that expanding the class of functions describ- 
ing the real constant uncertainty from linear to sector-bounded nonlinear functions 
introduces conservatism to the stability tests. This follows because PFr c and W&n can 
only be selected from a subset of V/c and Af/c for any nonlinear function. The off-axis 
circle interpretation provides a qualitative measure of the conservatism of various 
restrictions on the parameterization of the multipliers. 

Most importantly of all, these results also indicate that, as long as the multiplier 
phase is nonzero, the criteria should be much less conservative than tests developed 
with multipliers that have zero phase. Thus, by deriving tests based on these nonlinear 
functions, the results in this thesis provide a major extension in the development of 
state space stability criteria for systems with real parameter uncertainties. 

Furthermore, a key advantage of this approach is that the state space tests, written 
as Riccati equations and Lyapunov functions, can easily be incorporated into an 77 2 
synthesis problem. The result provides a powerful robust control design technique. 
Other particular advantages of the approach are given in Section 5.3 after the synthesis 
technique has been developed. 

3.8 Summary 

This chapter investigates the robust stability analysis problem with both linear and 
nonlinear parameter uncertainties. A unifying framework based on the supply rate 
and storage function concepts of Willems [165, 166] was used to derive state space 
stability criteria for linear systems coupled with these nonlinearities. The wealth 
of literature on absolute stability theory [123,131,172] was used to reformulate and 
extend recent work by Haddad and Bernstein [66,69]. The resulting storage functions 
were combined to form parameter- dependent Lyapunov functions that restrict both 
the allowable time-variation and the class of the nonlinear uncertainties. Equivalent 
frequency domain criteria provide physical insight into the role of the free parameters 
in these stability conditions. In contrast to the standard Popov test [131], these 
stability conditions are presented in terms of frequency dependent off-axis circles. 

As shown, the frequency domain stability conditions are closely related to the 
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approach used in mixed /z theory. This observation leads to several conclusions: 
(1) The stability criteria and multipliers for the case of symmetric bounds on the 
nonlinear functions correspond to particular parameterizations of the upper bounds 
for real /z, (2) The physical interpretation of frequency dependent off-axis circles can 
be applied to the real /z upper bounds, yielding new insight to the conservatism of 
these tests, and (3) The restrictions on the center location for the circles provide a 
qualitative measure of the conservatism of the nonlinear models. 

These analysis results in this chapter indicate that this approach represents a 
major extension in the development of state space stability criteria for robust control 
with real parameter uncertainties. Furthermore, the connections, which have largely 
been ignored, are important because they unify absolute stability theory and many of 
the recent developments in robust control theory. The following chapters demonstrate 
how these stability conditions can be used to develop a combined T^/real /z synthesis 
technique. 

3.9 Relationship to Other Research 

The close connections between the work in this thesis and research on mixed /z can be 
extended to concurrent work on the Multivariable Stability Margin K m by Safonov et 
al. [34,141,142]. In these recent papers, the authors present the K m synthesis approach 
as an alternative to /z synthesis for systems with both real and complex uncertainties. 
As discussed by Doyle and Safonov [47,142], K m = 1/ft, so much of the discussion 
in Section 3.7 can be used to develop close connections between K m analysis and 
the results in this thesis. The work by Safonovef al. focuses on modifying two key 
features of /z theory. One goal is to extend /z theory to systems with real and complex 
uncertainties. A second goal of their work is to eliminate the curve-fitting step in 
the synthesis algorithm. These goals are very similar to the ones that motivated the 
work in this thesis, and thus it is important to understand the relationships between 
the two approaches. 

We consider the framework in Fig. 3.1 because K m analysis was explicitly devel- 
oped for systems with linear uncertainties. In this approach, both real and complex 
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uncertainties are considered by relaxing tbe restrictions on the scaling functions in 
Fig. 3.1. In particular, they introduce new multipliers M(s ) that can be real or com- 
plex functions of frequency. The Popov multiplier in Eq. 3.3 is one particular M(s) 
function, so the functions are called Generalized Popov Multipliers [34]. It is quite 
clear that these functions M(s ) are closely related to the multipliers in Eq. 3.44. Sa- 
fonov and Lee [142] refer to the case of nonlinear uncertainties and the connections 
to frequency domain tests by Cho and Narendra [35]. However, they do not develop 
these interpretations to the same depth that is presented in this thesis. As shown 
in Sections 3.4 and 3.6, these frequency domain tests provide important geometric 
interpretations of the characteristics of the uncertainties considered by the stability 
tests. The off-axis circle criteria also illustrate the importance of the multiplier phase 
in these stability tests, and they demonstrate the role of the free parameters in the 
state space tests. 

Since the approach in this thesis and K m synthesis are both developed using 
concepts from absolute stability theory, the analysis tools are quite similar. However, 
the analysis techniques are developed using two different approaches that reflect the 
difference in the synthesis algorithms. As discussed in the Introduction, K m synthesis 
uses the standard D-K iteration for controller synthesis. As a result, the controllers 
are designed using PLoo or small gain theory [117]. The synthesis approach in this 
thesis is discussed in detail in Chapters 4 and 5. For now, it is sufficient to note that 
the technique involves an PL 2 synthesis approach that is modified by including the 
state space analysis tests from this chapter. As shown, the criteria were developed 
in this chapter using the concepts of supply rates and storage functions to test for 
system dissipation. Of course, it is well known that these small gain and passivity 
tests for stability are closely related [4]. 

, One difficulty with p synthesis is that, for each iteration, a series of convex op- 
timization problems must be solved to obtain the scaling functions D(juj). These 
functions must then be approximated by curve-fitting [117]. This difficulty is com- 
pounded in the real p case because there are now two scaling functions. In K m 
synthesis, these scaling functions axe parameterized by the fixed-order polyno mials 
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M(s). A new convex optimization problem is then solved to obtain the multiplier 
coefficients. The result is a modified synthesis approach called an M-K iteration. 

There are several advantages to the 2 synthesis approach that will be developed 
in the Chapters 4 and 5. First of all, the synthesis problem with an 7^2 performance 
objective can be solved with a single optimization algorithm. The solution then 
yields both the optimal robust controller and the optimal multipliers. Solving for 
these parameters simultaneously eliminates the need to explicitly iterate between 
multiplier evaluation and controller synthesis. Furthermore, the approach is presented 
for the case of reduced-order controllers, and can easily be extended to the case with 
architecture constraints on the compensator [109]. These two restrictions are essential 
for most realistic systems, but they cannot be directly addressed by either /i or K m 
synthesis techniques. These points will be discussed in more detail at the end of 
Chapter 5. 
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Chapter 4 


Robust Performance Synthesis 


The discussion in Section 3.7 demonstrated that the stability analysis tests in Chap- 
ter 3 are very effective for systems with constant real parameter uncertainties. The 
next step is to develop techniques for designing robust controllers based on these 
criteria. This chapter uses the J?-bound framework from Section 2.4 to include these 
stability criteria in a synthesis approach that minimizes an overbound of an 7^2 norm 
of the performance. In the following derivation, the analysis results of the previous 
chapter are specialized to the case of linear uncertainties. Many of the developments 
in this chapter follow Haddad, How, Hall, and Bernstein [72]. 

4.1 Introduction 

As shown in Section 3.5.1, in order to account for the extra dynamics introduced 
by the stability multiplier, the resulting state space model is of increased dimension. 
Therefore, let U C R” aXn “ denote a set of perturbations a A a of a given nominal 
augmented dynamics matrix A a E R Tl “ Xn “. Within the context of robustness analysis, 
it is assumed that A a is asymptotically stable and OgU. The results in Section 2.4 
can be applied to this augmented system to determine whether or not A a + a A a 
is asymptotically stable for all a A a E U. Note that, since A a in Eq. 3.57 is lower 
block triangular, it follows that, if A a + A A a is asymptotically stable, then A + A A is 
asymptotically stable for all perturbations aA. With the development in Section 2.4, 
the next step, which is to determine the parameter-dependent Lyapunov functions. 
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4.2 Construction of Parameter-dependent Lyapunov Func- 
tions for Monotonic and Odd Monotonic Nonlinearities 

From the theoretical basis of the approach in Section 2.4, the next step is to specify 
the structure of the set U and the parameter- dependent bounding function •!?(-, •). 
Specifically, the uncertainty set U is defined by 


U i |aA q g R noXn “ : A A a = -B a F 

(i + m- x f) 'c^fgf}, 

(4.1) 

where F satisfies 



F = G R mXm : 

F> 0}, 

(4.2) 


and where B a G R n * Xm and C a E R mXna are fixed matrices denoting the structure of 
the uncertainty, M G R mXm is a given diagonal positive-definite matrix, and F G R mXm 
is a diagonal uncertain matrix. An alternative characterization of the uncertainty set 
U can also be given. In order to state the next result, define the subset F of F by 

F±\p: F = F(l + M- 1 F)~\FGFY (4.3) 

where by Lemma 3.2 of Ref. [67], det(7 + M~ X F) ^ 0. 

Proposition 4.1. Let M G R mXm be positive definite. Then 

F — |jP g R mXm : det(J - FM' 1 ) ± 0 and FM~ X F < P} . (4.4) 

Proof. (Haddad et al. [72]) “C:” Let F&F. Then there exists F EF such that 
F = F{I -(- M~ l F)-\ Hence, FM~ X = F(I + M~ l F)~ 1 M~ x so that 

spec (FAT 1 ) = spec[F(I -f M~ 1 F)~ 1 M~ 1 } 

= spec[M _ 1 i r (J + M~ X F)~ X ] 

= { 5 ^: AespecfM-'F)), (4.5) 

where “spec” denotes spectrum. Hence, spec(F’M -1 ) does not include 1, and det(7 — 
FM~ X ) 7 ^ 0. Next, note that F = (I — FM _ 1 ) _ 1 F. Hence, it follows that 

F - FM~ X F = -F{I - M~ X F) + -(7 - FM- X )F 
2 2 

= -(7 - FM- 1 ) [(J - FM~ 1 )~ X F + F{I - M- X F)] (7 - M~ X F) 

= (7-7 , M- 1 )F(7-7ilT 1 )>0, (4.6) 
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which proves “C”. 

“D:” Let F be such that det (7- FM -1 ) ^ 0 and FM^F < F. Since det(7 — 
FM -1 ) ^ 0, define F = (7 — F M -1 ) -1 F . It then follows that 


F=-(I- FM-'Y'F + -F(I - FM- 1 )' 1 
2 2 

= \{I - FM- 1 ) -1 [f(7 - FM -1 ) + (7 - FM- 1 )^] ( I - FM- 1 )- 1 
£ 


-lN-l 


= -(I-FM~ 1 ) 


F - FM^F 


(7 — FM- 1 ) -1 > 0 . 


(4.7) 


Hence, FeJ 7 . Furthermore, because F = (7 — FM~ 1 )~ 1 F is equivalent to F = 
F(I + M^F)- 1 , F E!F, which proves “D”. □ 

Finally, the following key Lemma shows the equivalence of 0 < F < M and the 
structure presented in Proposition 4.1. 


Lemma 4.1. Let F E R mXm be a nonnegative definite diagonal matrix and M E 
pjmxm a p 0S m ve definite diagonal matrix. Then FM^F < F if and only ifO<F< 
M. 


Proof. The proof is a direct consequence of Lemma 4.4 in Ref. [66]. □ 

Now, it follows from Proposition 4.1 and Lemma 4.1 that an equivalent represen- 
tation for the uncertainty set U in Eq. 4.1 is 

U k {a A a E R naXna : a4 b = -B a FC a , FeP). (4.8) 

For the structure of U satisfying Eq. 4.1, the parameter-dependent bound J7(-, •) 
satisfying Eq. 2.34 can now be given a concrete form. Since the elements a A a in U 
are parameterized by the elements F in T 7 , for convenience in the following results 
Po( A.A a ) will be replaced with Po(F). 

Proposition 4.2. Let No, Nj, Hj, Sj E R mXm be nonnegative definite diagonal 
matrices and H 0 E R mXm be a positive definite diagonal matrix. Assume that, as in 
Theorem S.2, Ro > 0, and that these matrices satisfy 

NjSj -Hj>0, j = 1, . . . , m 2 . (4.9) 
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Then the functions 


mi 


TT12 


n 0 (P) = [H 0 C a + N 0 C a A a + Y,H j (C a -R j )+ £ Hj(C a + Rj) — BfP^Rf 1 


J = 1 
mi 


j=mi -f 1 
m2 


[H 0 C a + N 0 C a A a + £ Hj{C a - Rj) + £ H i(°« + R i) ~ B ? p }> ( 4 - 10 ) 

3 = 1 j'=mi+l 


m2 


P 0 (F) = C?(I + M-'F)- 1 [FiVo + FM-'NoF] (I + M-'FY'Ca + £ R'jFNjRj, 

j=i 

(4.11) 


or, equivalently, 


m2 


P 0 {F) = C^FNoCa + £ Rj(I - FM~ 1 )~ 1 FN j Rj, 

i=i 


(4.12) 


satisfy Eq. 2.34 with U given by Eq. 4-1- 


Proof. The proof is a direct consequence of Theorem 3.2, with f(y) = Fy = 
F(I + M~ 1 F)~ 1 C a x a . For further details on a similar proof, see Ref. [66]. □ 

The definitions in Proposition 4.2 can be combined with Theorem 2.1 (with an 
appropriate change in notation) to yield: 


Theorem 4.1. Let No, Nj, Hj, Sj £ R mXm be nonnegative definite diagonal ma- 
trices and Ho £ R mXm be a positive definite diagonal matrix. As before, assume that 
R 0 > 0 and Eq. 4-9 is satisfied. Furthermore, suppose that there exists a nonnegative 
definite matrix P satisfying 

0 = A T a P + PA a + R 

mi m2 

+ [ ff„C. + N„C.A. + •£ H,(C . - Rj) + £ Hj(C. + Rj) - B*P)] T I% 1 

3 = 1 3=m i+l 

mi m2 

[ H 0 C a + NoC a A a + £ Hj{C a ~ Rj) + £ Hj ( C a + Rj) - B a r P],(4.13) 


Then 




(A a + aA 0 , E)is detectable, V a A a G H, 

(4.14) 

if and only if 




A a + aA q is asymptotically stable, V A A a £ U. 

(4.15) 
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(4.16) 


In this case , 


J{ll) < tr PV -f sup tr 


m 2 

(C^FN 0 C a + J2 R J( I - PM -1 )' 1 FNjRj)V 

j=i 


Proof. The result is a direct specialization of Theorem 2.1 using Proposition 4.2. 

Note that P 0 (AA a ) now has the form Po(F) = CjFN 0 C a +Y2 R j(I~FM~ 1 )~ 1 FNjR j . 

i=i 

Since FNj > 0, j = 0, . . . ,m 2 , for all F € ^ it follows that P + Po(F) is nonnegative 

A A 

definite for all F G T as required by Theorem 2.1. □ 

Theorem 4.1 is directly applicable to dynamic systems with m-mixed uncertainties. 
Specifically, it follows from Theorem 3.2 that if the nonlinearity f(y) is an m-vector 
composed of n\ time-invariant first and third quadrant functions, n 2 — ni monotone 
increasing functions, and m—nz odd monotone increasing functions, then the nominal 
system is robustly stable for all such mixed uncertainty. Furthermore, in the linear 
uncertainty case, f(y) = Fy it was recently shown by Haddad and Bernstein [66] that 
under certain compatibility assumptions between N 0 and T (for the Popov case), the 
set 1A allows a richer class of multivariable uncertainties in that F may represent a 
fully populated uncertainty matrix. 

It is the compatibility conditions between T and the multiplier matrices (in this 
Popov case N 0 ) that enforce the structure of the uncertainty in the block A. As 
discussed by Haddad and Bernstein in Ref. [67], many tests are overly conservative 
for systems with multiple uncertainties because they do not account for the structure 
in the internal feedback model. As an example, consider the system from Ref. [45] 
with multiple uncertainties and a stability test based on the small gain theorem. The 
structure of these uncertainties can be specified in the problem statement, but the 
resulting stability test considers a completely unstructured block A [124]. There is no 
equivalent of the compatibility conditions to enforce the structure of the uncertainty, 
and, as a result, the unstructured analysis tests can be very conservative, even if the 
uncertainties are complex. 
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4.3 Static Output Feedback Controller Synthesis 

This section introduces the robust stability and performance problem with static 
output feedback control. As mentioned in the previous section, due to the extra 
dynamics introduced by the multiplier, the resulting state space model is of increased 
dimension. Hence, this problem involves a set U C R naXn “ of uncertain perturbations 
a A a of the nominal augmented system matrix A a . 

Robust Stability and Performance Problem. Given the nj^-order stabiliz- 
able augmented plant with constant real-valued plant parameter variations 

x a (t) = (A a + &Aa)x a (t) + Bu(t) + Dw(t), t E [0, oo), (4.17) 

y(i) = <7*.(t), (4-18) 


where u(t) E R m ° and w(t) E R d , and y(t) E R 1 , determine an output feedback control 
law 

u(t) = Ky(t ) ( 4 - 19 ) 

that satisfies the following design criteria: 

(i) the closed-loop system Eqs. 4.17-4.19 is asymptotically stable for all A A a EU, 
that is, A a + BKC + a A a is asymptotically stable for all aA g EU\ and 


(ii) the performance functional 

J(K)= sup limsupjE{/ [xj (s)R xx x tt (s) + 'u T (s)R utl 'u(s)] ds} (4.20) 

AAo€W t-*oo t JO 
is minimized. 


The aim is to control the actual system dynamics, i.e., the non-augmented dynam- 
ics. So, in accordance with the partitioning in Eq. 3.57, the control, measurement, 
disturbance, and state weighting matrices B, C, D, and Rx X , have the structure: 


’ B 

r a 1 

, D = 

' d' 

, Rxx = 

Rxx 

o' 

, c= \c 0 

0 

0 

0 

. 

’ L J 



0 


(4.21) 


For each variation a A a E 77, the closed-loop system in Eqs. 4.17-4.19 can be written 


as 

x Q (i) = (A + a A a )x a (t) + Dw(t), t E [0, oo), (4.22) 
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where 


AkAa + BKC, (4.23) 

and the white noise disturbance has intensity V = DD T . Finally, note that if A a +A.A a 
is asymptotically stable for all &.A. a G 14 for a given K , then Eq. 4.20 can be written 
as 

J(K)= sup tTP AAa V, (4.24) 

A Aa£U v ' 

where P AAa satisfies Eq. 2.29 with A replaced by A and R replaced by 

R=R XX + C T K T R m KC. (4.25) 

To consider controller synthesis, the performance bound Eq. 2.39 is used to replace 
the actual H 2 performance as in Theorem 4.1, with A a , R replaced by A and R to 
address the closed-loop control problem. This results in the following optimization 
problem: 

Optimization Problem. Determine K G R m ° x * that minimizes 

7712 

J(K) £ tr PV + sup tr [(C?FNoC a + ~ FM~ X )~ x FNjRj)V] (4.26) 

fie* ;= i 

subject to 

0 = A T P + PA + R 

A m l m 2 

+ [ H 0 C a + N 0 C a A + '£H j (C a -R j )+ £ + Rj) - B T a P] T R~ l 

3 — 1 j=m i +1 

nti m 2 

[ H 0 C a + N 0 C a A + Hj{C a - Rj) + £ HfiC* + Rf) - BjP].(4.27) 

3 = 1 7=771! +1 

The following proposition provides the relationship between this optimization 
problem and the robust stability and performance problems: 

Proposition 4.3. If P e N n ‘, K G R m ° xl satisfies Eq. 4.26, and the detectability 
condition Eq. 2.36 holds, then A + a A a is asymptotically stable for all a A a G 14 , and 

J(K) < J{K). (4.28) 
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Proof. Since Eq. 4.27 has a solution P E N n “ and the detectability condition 
Eq. 2.36 holds, the hypotheses of Theorem 2.1 are satisfied, so that robust stability 
with a robust performance bound is guaranteed. The condition in Eq. 4.28 is merely 
a restatement of Eq. 2.39. ^ 

Note that, since the last term in Eq. 4.26 is not a function of either the controller 
gain K or the constraint Eq. 4.27, it plays no role in the current optimization process. 
However, this last term does contain information about the multiplier, and will play 
a important part in the developments of the next chapter. The sufficient conditions 
for robust stability and performance with static output feedback are presented next. 


For arbitrary P, QE R n “ Xn “ define the notation: 

mi 

7712 

(4.29) 

C k H 0 C a + N 0 C a A a + £ Hj(C a - Rj) + 

£ Hj{Ca + Rj), 

j=i 

j=TOl+l 


R 2a kR^ u + B T C T a N 0 RZ 1 N 0 G a B , 


(4.30) 

P a k B t P + B T CJN 0 RZ\C - BjP), 


(4.31) 

Ap = A a — B a R 0 x C, 


(4.32) 

V k gC ,T (C'QC ,T )- 1 C7, v L k I na - V, 


(4.33) 

when the indicated inverses exist. 




Theorem 4.2. Assume Ro > 0 and assume Eq. 4-9 holds. Furthermore, suppose 
there exist n a x n a nonnegative definite matrices P,Q such that CQC T > 0 and 

0 = ApP + PAp + Rxx + C T R 0 X C + P B a Ro X B^ P 

- Pj R^ P a + v]_ Pi R 2 I p * , ( 4 - 34 ) 

0 =[Ap + ( BaRo'NoCa - I)BR£P a v + B a R^ x B T a P\ Q 

+Q [Ap + {BaR^NoCa - I)BR£P a u + B'RZ'Blpf + V, (4.35) 

and let K be given by 

K = -RZlP a QC T {CQC T )~ 1 . (4.36) 

Then (A+aA 0 , R) is detectable for all A A a £ U if and only z/A+aA* is asymptotically 
stable for all A A a G U. In this case the closed-loop system performance in Eq. 4-H 
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satisfies the parameter-dependent 7i 2 bound 

TJ1>2 

J{K) < tr PV + sup tr [(C?FN 0 C a + £ - FM-'Y'FNjRfijV]. (4.37) 

F&F j = i 

Proof. The proof follows from a similar one by Haddad and Bernstein [66]. □ 

Remark 4.1. The definiteness condition CQC T > 0 holds if C has full row rank 
and Q is positive-definite. Conversely, if CQC T > 0, then C must have full row rank 
but Q need not necessarily be positive-definite. This condition implies the existence 
of the static gain projection v. □ 

4.4 Dynamic Output Feedback Controller Synthesis 

The next step is to consider the robust stability and performance problem with dy- 
namic output-feedback control. Since the multiplier dynamics increase the plant order 
from n to n OJ to allow for greater design flexibility, it is assumed that the compen- 
sator dimension n c can be less than the augmented plant order n a . Hence, define 
n = n a -f n c . Note that in this context, an n^-order controller can be regarded as a 
reduced-order design. The constraint leads to an oblique projection that introduces 
extra equations and extra coupling [88]. The coupling shows that regulator/estimator 
separation breaks down in the reduced-order controller case. 

Dynamic Robust Stability and Performance Problem. Given the n^-order 
stabilizable and detectable plant with constant structured real- valued plant parameter 
variations 


x a (t) = ( A a + a A a )x a (t) + Bu(t ) + Di w(t), t> 0, (4.38) 

y(t) = Cx a (t) + D 2 w(t), (4.39) 

where u(t) € R m °, w(t) € R d , and y(t) 6 R 1 , determine an n^-order dynamic compen- 
sator 


x c (t) = A c x c (t ) + B c y(t), (4.40) 

u(i) = C c x c {t), (4.41) 

that satisfies the following design criteria: 
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(i) the closed-loop system in Eqs. 4.38-4.41 is asymptotically stable for all A A a £U\ 
and 

(ii) the performance functional in Eq. 4.20 with J(K) replaced by J(A C ,B C , C c ) is 
minimized. 


For each uncertain variation A A a € U , the closed-loop system in Eqs. 4.38-4.41 can 
be written as 

x(t) = (A + a A)x(t) + Dw(t), t > 0, (4.42) 

where 


33a(i) 


' A a 

BC c 

, and a A = 

AA a 0 n<I xnc 

_ X c{t) _ 


B c C 

Ac 


0n c Xn 0 On^XTic 




The closed-loop disturbance Dw(t ) has intensity V = DD T , where 


(4.43) 




D 1 

B c D 2 


so that V = 


Vi 0 

0 B c V 2 bJ 


(4.44) 


where Vi = D\D f and V 2 = D 2 D 2 . The closed-loop system uncertainty a A has the 
form 

a A = —B a FC a , (4.45) 


where 


BA 


B a 

OricXm 


, <?«£ 


C'a 0 m xn c 


(4.46) 


Finally, if A + a A is asymptotically stable for all A A a 6 U for a given compensator 
(A c ,B c ,C c ), then it follows from Proposition 2.1 that the performance measure in 
Eq. 4.19 is given by 

J(A c ,B c ,C c ) = sup tr P A ^V, (4.47) 

A A a eu 

where Paa satisfies the n X ft Lyapunov equation 

0 = {A + a A) T + P aa (A + aA) + R. 

For this equation, define 


(4.48) 


(4.49) 
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To proceed, the Lyapunov Eq. 4.48 is replaced with a Riccati equation that guar- 
antees that the closed-loop system is robustly stable. Then, for the dynamic output 
feedback problem, Theorem 4.1 holds with A a , R, V replaced by A, R, V. For clarity, 
the dynamic optimization problem can be stated as: 

Dynamic Optimization Problem. Determine the controller ( A c , B c , C c ) that 
minimizes 

T7l2 

J(A c ,B c ,C c ) £ tr PV+ sup tiiiCZFNoCa+^Rjil-FM-'y'FNjR^V}, (4.50) 

F€7 j = 1 

where Rj = [ Rj 0 mXnc ], and P G N n solves 


0 = A T P + PA + R 


m i 


m 2 


+ [H 0 C a + N 0 C a A + '£H j (C a -R j )+ £ Hj(C a + R 3 ) - B^PfR' 1 

J=1 i=mi+l 

TJll T712 

[H 0 C a + N 0 C a A + J2H j (C a -R j )+ £ Hj{C a + Rj)-B^P], (4.51) 

3 = 1 j=mi +1 


with 


Ro = 


m 2 


m 2 


( NoC a B a + £ HjM- 1 ) + ( N 0 C a B a + £ HjM^f 

j=0 j=0 


> 0 , 


(4.52) 


such that (A c , B c , C c ) is minimal, and Eq. 4.9 holds. 

Deriving the optimality conditions for the dynamic optimization problem yields 
equations that characterize the fixed-order dynamic output feedback controllers which 
guarantee robust stability and performance. The following lemma is required for the 
statement of the main theorem: 


Lemma 4.2. (Bernstein and Haddad [19]) Let Q,P be n a x n a nonnegative def- 
inite matrices and suppose that rank QP = n c . Then there exist n c x n a G,T and 
n c x n c invertible M, unique except for a change of basis in R ne , such that 

QP = C?MT, TG t = I nc . (4.53) 

Furthermore, the n a x n a matrices 

Tj.i7n.-T, (4.54) 

are idempotent and have rank n c and n a — n c respectively. 
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Proof. See Bernstein and Haddad [19]. □ 

The main results of this section concerning reduced-order controllers can now be 
stated. Recall the definitions of Ro, P a , Ap , R 2a , C, and define 

E^ C T V 2 X C, (4.55) 

Ap = A a - QX-B a R^(C - B T a P ), (4.56) 

A$ = Aa- BR£P a + BaR^NoCaB^Pa - B a R-\C - B T a P ), (4.57) 

for arbitrary Q, PS R" aXn<I . 

Theorem 4.3. Letn c < n a , and assume Ro > 0 and Eq. 4-9 holds. Furthermore, 
suppose there exist n a x n„ nonnegative definite matrices P,Q,P,Q satisfying 

0 = A T P P + PA P + R XX + C t Rq 1 C + PBnR-'BlP - PjP^P* 


+rlPjR^P a r ± , (4.58) 

0 = (A P + B a Rt l B T a [P + P])Q + Q(A P + B a R^B* [p + P\ f 

+V X - QZQ + rjQSQrx, (4.59) 

0 = A T p P + PAp + PB a R^BjP + PjR^Pa - rlPjR^P a r ± , (4.60) 

0 = A$Q + QAl + QYiQ - t ± QXQtZ, (4.61) 

rank Q = rank P = rank QP = n c , (4.62) 

with A c , B C) C c given by 

A c = r [a$ - QS] G t , (4.63) 

B c = YQC t V 2 ~\ (4.64) 

C c = ~^P a G T . (4.65) 


Then (A + aA, E) is detectable for all A A a EU if and only if A+ A A is asymptotically 
stable for all a A a € U. In this case, the performance of the closed-loop system Eq. 4-4 % 
satisfies the parameter-dependent TL 2 bound 

J{A C , B e , C c ) < tr [(P + P)V i + PQZQ] 

77X2 - 

+ sup tr [(CjFN 0 C a + £ Rj(I ~ FM-'y'FNjR^ViUtM) 

Per j = 1 
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Proof. The proof of Theorem 4.3 involves a complicated manipulation of al- 
gebraic equations. For simplicity, only the key points are presented. To optimize 
the overbounding cost J in Eq. 4.50 subject to the constraint in Eq. 4.51, form the 
Lagrangian 

C(A c , B c , C c , P, Q, A) £ tr [(RHS of 4.50)A + <?(RHS of 4.51)]. (4.67) 

The Lagrange multipliers A > 0 and Q 6 R nX " in this equation are not both zero. 
Setting dC/dP = 0, A = 0 implies that Q = 0. Hence, it can be assumed without 
loss of generality that A = 1. Furthermore, Q is the nonnegative definite solution of 

771 7712 

0 =[A- B a R?{H 0 C a + N 0 C a A + £ Hj{C a - Rj) + £ Hj(C a + Rj) - B T a P)]Q 

. j= 1 J=mi +1 

7711 7712 

+ Q[A - B a Rz\H 0 C a + N 0 C a A + 2 Hj{C a - Rj) + ^ Hj{C a + Rj) - H a T P)] T + V 

j= 1 i=mi +1 

(4.68) 

The remainder of the derivation parallels the technique in Ref. [18], with the principal 
steps being: 

Step 1: Compute dC/dA c , dC/dB c , and dC/dC c . 

Step 2: Partition Eqs. 4.51 and 4.68 into six equations (a)-(f) that correspond to 
the n x n, n x n c , and n c x n c blocks of P and Q. Since the compensator triple 
(■A c , B C: C c ) is controllable and observable, the lower righthand n c x n c blocks 
of P and Q are positive definite. 

Step 3: Multiply Eq. (b) by the n x n c sub-block of Q and add it to the n c x n c 
sub-block of Q times Eq. (c). The result can be used to define the projection 
r and the new variables P, Q, P, Q, G , and T. 

Step 4: Use the results of step 1 and step 3 to solve for the compensator matrices 
in Eqs. 4.63-4.65. 

Step 5: This is the key step in the process. With the results from the previous steps, 
Eqs. (a), (b), (d), and (e) can be manipulated to yield Eqs. 4.58-4.61. 
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Step 6: The results of step 3 can then be used to demonstrate that Eq. 4.66 is 
equivalent to Eq. 4.50. 

□ 

Remark 4.2. Several special cases can immediately be discerned from Theo- 
rem 4.3. For example, in the full-order case, set n c = n a so that r = G = T = I na 
and t± = 0. In this case, the last term in each of Eqs. 4.58-4.60 is zero and Eq. 4.61 
is superfluous. Alternatively, letting B a = 0, C a = 0 and retaining the reduced-order 
constraint n c < n a yields the results of Ref. [88]. Finally, setting m 2 = 0 yields the 
results of Ref. [66] for the case in which F is diagonal. □ 

Theorem 4.3 provides constructive sufficient conditions that yield reduced-order 
dynamic feedback gains A c , B c , C c for robust stability and performance. Note 
that when solving Eqs. 4.58-4.61 numerically, the matrices M, Nj, Hj , and Sj, 
j = 0, ...,m 2 , and the structure of B a and C a appearing in the design equations 
can be adjusted to examine tradeoffs between performance and robustness. To re- 
duce the conservatism even further, the multiplier matrices Nj, Hj, and Sj can also 
be viewed as free parameters in the optimization of the worst case W 2 performance 
bound. The optimal compensators and multipliers can then be computed simultane- 
ously, avoiding the need for an iterative solution algorithm. A numerical algorithm 
for a particular form of this problem is presented in the next chapter. 

4.5 Summary 

This chapter uses the 12-bound framework to develop a synthesis approach for robust 
control design using the state space analysis tools presented in Chapter 3. For a spec- 
ified LQG problem, the 7-f 2 cost functional is replaced with a parameter-dependent 
7f 2 bound. The overbound contains terms related to the extra constraints on the 
robustness of the controllers. The standard Lyapunov equation in the LQG synthesis 
is also replaced with a Riccati equation from Theorem 3.2. A nonnegative definite 
solution to this Riccati equation guarantees that the closed-loop system is robustly 
stable. The controllers then guarantee stability and minimize an ?f 2 performance ob- 
jective. The optimality conditions for a reduced-order robust controller are presented 
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in Theorem 4.3. The discussion at the end of the chapter also indicates that conser- 
vatism can be reduced even further by optimizing this overbounding cost functional 
with respect to the multipliers. This step is explored in detail in the next chapter 
which deals with the Popov synthesis problem. 
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Chapter 5 


Robust Controller Synthesis with 
Diagonal Popov Multipliers 


In this chapter, we continue the controller synthesis algorithm by considering a special 
case of the robust performance problem in Chapter 4. In particular, the following 
sections consider the case of m independent, sector-bounded, scalar uncertainties with 
multipliers of the standard Popov form: . 


Wi(.s) = a i0 + fas. (5.1) 

These restrictions simplify the notation of the previous chapter, so the following sec- 
tion restates the problem formulation to demonstrate the entire synthesis procedure 
as outlined at the end of Chapter 4. The Lagrangian formulation for the optimal 
robust controller is also presented. The potential conservatism of the approach is 
further reduced by optimizing the cost bound with respect to the multiplier matrices. 
A numerical algorithm for solving the necessary conditions is also presented. The 
chapter concludes with a discussion on the relative merits of the synthesis approach 
in this thesis and mixed /z (K m ) synthesis. 

5.1 Parameter-dependent Lyapunov Functions for Popov 
Multipliers 

For simplicity, the following development considers the case illustrated in Fig. 2.2, 
with m independent scalar uncertainties. The more general, fully populated uncer- 
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tainty matrix case is considered by Haddad and Bernstein [66]. The first step is to 
define the uncertainty set U and the parameter-dependent bounding function f?(-, •). 
The diagonal matrices Mi , M 2 G D m are introduced for the problem with indepen- 
dent scalar uncertainties. It is assumed that M 2 — Mi is positive definite and thus 
invertible. For this class of uncertainties, the set U is defined as 

U £ {aA 6 R nXn : aA = -B 0 FC 0 , F e F}, (5.2) 

where F is given by 

F = {F eD m : Mi < F < M 2 }, (5.3) 

Bq G R nXTn and Co € R mXn are fixed matrices denoting the structure of the uncertainty, 
and F E D m is an uncertain matrix. 

Since F£F is constrained to have the diagonal structure diag[Fi, F 2 , ■ ■ . , F m ], 
define M x = diag[M n , Mi 2 , M im ], and similarly for M 2 . In this case, M 2 and Mi 
represent upper and lower bounds, respectively, on the uncertain diagonal matrix F 
because Mu < Fi < M 2 i, i = l,...,m. As in Chapter 4, P 0 (aA) is replaced with 
P 0 (F). These results are based on the notation in Section 2.4 and Chapter 4. 

Proposition 5.1. Let Mi,M 2 ,Ho,No€D m be such that M 2 — Mi is positive 
definite, Ho and No are positive and nonnegative definite respectively. Redefine 

Ro = [H 0 (M 2 - Mi)- 1 + N 0 C 0 B 0 ] + [H 0 (M 2 - M x)" 1 + N 0 C 0 Bo] T > 0. (5.4) 

Then the functions 

n 0 (P) = [H0C0 + NoCo(A - B0M1C0 ) - B^PfR^ 1 

[H0C0 + N 0 Co(A - B0M1C0) - B*P] 

-PB 0 M 1 C 0 ~ Cq Mi B qP, 

P 0 (F) £ Cq(F - Mi)N 0 C 0 , 

satisfy Eq. 2.34 w ith U given by Eq. 5.2. 

Proof. See Haddad and Bernstein [70]. □ 
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(5.5) 

(5.6) 


The results of Theorem 2.1 and Proposition 5.1 can now be used to present an 
upper bound for the TL 2 performance of a system that satisfies the conditions for 
robust stability for all perturbations 14 given by Eq. 5.2. 

Theorem 5.1. Let M x , M 2 , Ho, No E D m be such that M 2 —M x is positive definite , 
Rq > 0, Ho is positive definite , and No is nonnegative definite. Furthermore, suppose 
there exists a nonnegative definite matrix P satisfying 


0 = (A - BoMrCofP + P(A - B 0 M x Co) + [ H 0 C 0 + N 0 C 0 (A - B 0 MiC q ) - B^P) T 


Ro 1 [tfotfo + NoCo(A - BoMiCo ) - B*P] + R. 

(5.7) 

Then 


(A + aA, E) is detectable, V a A € 14, 

(5.8) 

if and only if 


A + A A is asymptotically stable, V A A E 14. 

(5.9) 

In this case, 


J(U) < J{U) k tr [P + Cq(M 2 - Mi)N 0 Co]V. 

(5.10) 


Proof. The result is a direct specialization of Theorem 2.1 using Proposition 5.1, 
where Po{F) now has the form in Eq. 5.6. Since F is lower bounded by M x and N is 
nonnegative definite and diagonal, then ( F — M X )N > 0 for all F It then follows 
that P + Po(F ) is nonnegative definite for all F E T, as required by Theorem 2.1. □ 
The results in Section 3.6 can be used to present a sufficient condition for the 
existence of a solution to Eq. 5.7 in Theorem 5.1. 


Theorem 5.2. Let 


G(s) 


min 

r>-/ 


A — BoM x Co 

Bo 

HqCq + N 0 Co(A — BqMiCq) 

Hq(M 2 — M\) 1 + NqC 0 Bo 


(5.11) 


If A is asymptotically stable and G(s ) is strongly positive real, then there exists an 
n x n matrix P > 0 satisfying Eq. 5. 7. Conversely, if Rq > 0 and there exists P > 0 
satisfying Eq. 5.7 for all R > 0, then A is asymptotically stable and G(s) is strongly 
positive real. 
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Proof. This result is an immediate consequence of the discussion in Section 3.6. 

□ 

The results in Theorem 5.1 can now be used to complete the development of the 
control synthesis procedure. 

5.2 Dynamic Output Feedback Controller Synthesis 

To expand on the development in Section 4.4, this section restates the dynamic robust 
stability and performance problems with this particular multiplier. The problem 
involves the set U C R nXn of the uncertain perturbations of the nominal system 
matrix A. As before, the optimization problem is specified and then replaced by an 
auxiliary minimization problem with an overbounding cost function. The optimality 
conditions for this auxiliary problem are presented in two forms - one more useful for 
numerical solution, and the other more enlightening in terms of the structure of the 
optimal compensator. 

Dynamic Robust Stability and Performance Problem. Consider the n 1 ^- 
order stabilizable and detectable plant with constant structured real- valued parameter 
variations 

x(t) = {A + AA)x(t) + Bu(t) + Dxw(t), t> 0, (5.12) 

y(t) = Cx(t) + D 2 w(t), (5.13) 

where u(t) € R m °,w(t) 6 R d , and y{t ) 6 R z . The problem is to determine an n^-order 
dynamic compensator 

x c (t) = A c x c (t) + B c y(t), (5.14) 

u(t) = C c x c (t), (5.15) 

that satisfies the following design criteria: 

(i) the closed-loop system in Eqs. 5.12-5.15 is asymptotically stable for all aAeU] 
and 

(ii) the performance functional 

J(A C , B c , C c ) = sup limsup yE{ f [x T (s)R xx s(s) + u(s) T Ru^s)] ds} (5.16) 

A A&U t—*oo t JO 
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is minimized. 


For the uncertainties aAeU, the closed-loop system in Eqs. 5.12-5.15 can be 
written as 

x(t) = (A + AA)x(t) + Dw(t), t> 0, (5-17) 

where 


x 




x(t) 

<11 

A 

BC c 

, and a A = 

aA 0 nX n c 

_ Xc(t) _ 


B c C 

Ac _ 


0n c Xn 0 nc xn c 


(5.18) 


Furthermore, the closed-loop disturbance Dw(t) has intensity V = DD T , where 




D 1 

B c D 2 


, so that V = 


Vi 0 
0 B c V 2 B t c 


(5.19) 


where Vi = D\D^ and V 2 = D 2 D^ . The closed-loop system uncertainty a A has the 
form 


a A = —B 0 FC 0 , where Bo = 

In this case, note that CqB 0 = CqBq so that 


Bo 

OricXm 


, and C 0 = C 0 0 mXne 


(5.20) 


Ro £ Ho{M 2 - M 1 )~ 1 + NoCoBo + [H 0 (M 2 - M 1 )~ 1 + N 0 CoBo] T , 

= Ho(M 2 — Mi) 1 + NoCqBo + [H 0 (M 2 — Mi) 1 + NoCqBo] t , 

= Ro. (5.21) 

Finally, if A -f- a A is asymptotically stable for all a A E IA and a given compensator 
(A c , B c , C c ), then the performance measure in Eq. 5.16 is given by 


J(A e ,B e ,C c ) = sup tTP AA V, 

A Aeu 

where Baa satisfies the (n + n c ) x (n + n c ) algebraic Lyapunov equation 

0 = (A + a A) T P ^ + P A j[(A + aA) + R, 

where 


(5.22) 


E = [ Ei E 2 C c ] , R = E t E = 


Rx* 0 

0 CjEunCc 


(5.23) 


(5.24) 
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As before, the results of Theorem 5.1 (with A, R, V replaced by A, R, V) are used 
to replace the Lyapunov Eq. 5.23 with a Riccati equation that guarantees that the 
closed-loop system is robustly stable. This leads to the following design problem: 
Dynamic Auxiliary Minimization Problem. Determine the compensator 
(A c , B c ,C c ) that minimizes the overbounding H 2 cost 

J(A C , B c , C c ) £ tr [P + Cl (M 2 - M 1 )N 0 C 0 }V, (5.25) 

where P G N n+ne satisfies 


0 = (A — BqMiCo) t P + P(A — BqMiCq) + \HqCq + NqCq(A — BqMiCq) — Bl P ] 


T 


Ro l [H 0 C 0 + N 0 C 0 (A - B 0 M 1 C 0 ) - BlP] + R, 


(5.26) 


such that (A c , B c , C c ) is minimal, H 0 and N 0 are positive and nonnegative definite 
respectively, and Rq > 0. 

The optimality conditions for the dynamic auxiliary minimization problem pro- 
vide sufficient conditions to characterize the reduced-order dynamic output feedback 
controllers that guarantee robust stability and performance. The approach outlined 
in the proof of Theorem 4.3 is used to derive these conditions. The cost overbound 
J(A C , B c , C c ) is augmented with the constraint in Eq. 5.26 using the Lagrange mul- 
tiplier Q G N n+ ” c . This leads to 

£(A C , Be, Ce, p, Q) = tr [{P + Cl(M 2 - M 1 )N 0 C 0 )V 
+<5{(A — BoMiCo) t P + P(A — B 0 MiC 0 ) + [HqCq + NqCo{A — BqMiCq) — PIP] T 
Ro'iHoCo + N 0 Co(A - BoMtCo) -BlP] + R}]. (5.27) 


Since the results are necessary to implement the numerical solution for the optimal 
controllers, the following presents the gradients of the augmented cost in Eq. 5.27 with 
respect to the free parameters A c , B c , C c , P, and Q. First, note that dC/dQ recovers 
Eq. 5.26. For convenience, partition the symmetric matrices P and Q as 


P = 


P\1 P\2 
f£ P* 



Q n Q 12 
Ql2 Q22 


(5.28) 
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and similarly for their product PQ. In Eq. 5.28, P n eRn x n and P 22 G R n c x n c . 
Then 

dC r - - - - . 

0 ~^p — [A — BqMiCq — BqR q (H 0 Co + NqCo(A — BqMiCq) — B$ P)]Q 

-\-Q\A — BqM\Cq — BoR q 1 {HqCo + NqCq(A — BqM\Cq ) — BqP)] t + V, (5.29) 
1 d 

0 — 2 = ^2 Q 12 + P 22 Q 22 = [PQ] 22 , (5.30) 

0 = 2 H = + ^kiC' 2 ', (5.31) 

1 d . JC - 

0 = 2 del = 5T(7 “ BoR ° lN °Co) T [PQ]l2 + (Run + B T Cq NqRq 1 NqCqB) C c Q 22 
+B t Cq NoR 0 1 [HqCq + NqCq{A — BqMiCo)]Q\ 2 ■ (5.32) 

The above gradient expressions can be used to derive explicit expressions for the 
optimal controller in terms of the solutions of four coupled Riccati equations. For 
convenience in stating the main result, recall the definitions of Rq and E = C ,T V 2 -1 (7, 
and redefine 


C = H 0 C 0 + N 0 C 0 (A — BqM\Cq), (5.33) 

R-2* = Ruu + B t Cq N 0 Ro 1 N 0 C 0 B, (5.34) 

P a £ B t P + B t CqN q R^ 1 (C - B*P), (5.35) 

Ap = A — BoM-iCo — BqR^C, (5.36) 

Ap = A P - QE + BoRq'BJP, (5.37) 

Aq = A P -\- BoR^BqP - (I n - BoR^NoCoJBR^Pa, (5.38) 

for arbitrary Q, P £ R nXn . 


Theorem 5.3. Let n c < n, assume Rq > 0, and let No and Hq be nonnegative 
and positive definite diagonal matrices, respectively. Furthermore, suppose there exist 
n x n nonnegative definite matrices P, Q, P, and Q satisfying 

0 = A t p P + PA P + R XX + C t Rq 1 C + P B 0 R^ X Bq P - P*R£P a 

+rJP a T i?- 1 P a r ± , (5.39) 

0 = {Ap + B 0 R?B%[P + P])Q + Q(A P + BqR^BqIP + P]) T 
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+Vi - Qsg + tZQEQtj., (5.40) 

0 = Ap + PAp + PB q R?B*P + PjR^Pa - rlPjR^P a r ± , (5.41) 

o = a$q + qaI + qeq - t ± qxqtZ ( 5 . 42 ) 

rank Q = rank P = rank QP = n c (5.43) 

with A c , B c , C c given by 

A C = T [Aq - gs] G T , (5.44) 

B c = TQO T Vf\ (5.45) 

C c = -B^P.CT. (5.46) 


Then {A + a A, E) is detectable for all aAgU if and only if A + A A is asymptotically 
stable for all a A&U. In this case the performance of the closed-loop system Eq. 5.17 
satisfies the Tt 2 bound 

J(A e , B c , C e ) < tr [(P + P + Cq{M 2 - M 1 )N 0 C 0 )V 1 + PQVQ\. (5.47) 

Proof. The proof follows the same outline given for Theorem 4.3. □ 

As discussed in the previous chapter, the diagonal matrices M\, M 2 , Hq, and No 
and the structure in B 0 and Co can be used to examine tradeoifs between performance 
and robustness. Also, conservatism can be further reduced by taking the multiplier 
matrices Ho and N 0 as free parameters and optimizing the worst case H 2 performance 
bound. The derivatives are 

= -(M 2 - M 1 )C 0 VC^ + R?[H 0 Co + N 0 Co{A - B 0 M 1 C 0 ) - B*P]Q 

2 0N0 2 

[(A - B 0 Mi Co) - B q RZ x {HoCo + N 0 C 0 (A - BoM.Co) - B 0 T P)] T C , 0 T ,(5.48) 
= RZ x [HoCo + N 0 Co{A - BoMrCo) - B%P]Q 

2 Olio 

[C 0 T - {HqCo + N 0 C 0 {A - B 0 M 1 C 0 ) - B 0 T P) T i^ 1 (M 2 - (5.49) 

Since No, Hq 6 D m , only the diagonal elements of dC/dNo and dC/dHo can be set to 
zero in the optimization process. 
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Remark 5.1. In the full-order case, set n c = n in Theorem 5.3 so that r = G = 
r = I n and t± = 0. Then the last term in each of Eqs. 5.39-5.41 is zero and Eq. 5.42 
is superfluous. □ 

Remark 5.2. If the plant uncertainty a A is such that C 0 B 0 = 0, then Ro and 
Eq. 5.48 are of a much simpler form. As will be seen in the next chapter, this condition 
holds for an important class of parameter uncertainties. □ 

5.3 Numerical Issues for Controller Synthesis 

There are several important issues to be considered in the development of an technique 
to numerically solve the optimality conditions in the previous sections. This section 
addresses these issues while providing an outline of the algorithm used to compute 
the controllers for the examples in the next two chapters. 

The robust compensators are developed using a BFGS (Broyden-Fletcher-Goldfarb- 
Shanno) quasi-Newton search algorithm to solve the optimality conditions in Eqs. 5.26, 
5.29-5.32, 5.48, and 5.49. [144,147,148]. As discussed in the previous section, the op- 
timal compensator and multiplier are obtained simultaneously. This avoids the need 
to explicitly iterate between controller design and optimal multiplier evaluation, as 
required in the current algorithms for fi synthesis [117] and K m synthesis [142]. 

The free parameters in the compensator and multiplier matrices are accumulated 
in the vector 

vec(A c ) 

vec(B c ) 

x = vec(C'c) . (5.50) 

diag(iVo) 

_ diag(ffo) . 

There are two main steps in the solution algorithm for the optimal x value. An inner 
loop step optimizes the cost functional by solving the gradient Eqs. 5.26, 5.29-5.32, 
5.48, and 5.49 for the current value of x. Each inner loop step is performed for fixed 
values of the stability bounds Mi and M 2 , which are changed in the outer loop. 

The inner loop itself consists of two main parts. The first of these determines a 
search direction that reduces the cost functional. The second part performs a line 
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search to determine the step size to be taken in this search direction. The purpose of 
the line search is to minimize the cost function in the specified direction subject to 
various error constraints, which are discussed later. If, at a particular value of x, a 
normalization of the system gradients is below a given tolerance, then this inner loop 
optimization is said to have converged to a solution. Then the bounds Mi and M 2 
are increased in the outer loop, and the current value of x is used as an initial guess 
for the next inner loop iteration. If the inner loop optimization fails to converge, 
the last increments in Mi and M 2 are reduced. This two step iterative process is 
continued until the desired stability bounds Mif and M 2 / are achieved, if possible. 
Consequently, the iteration in this design process is to develop a family of robust 
controllers which then facilitates an analysis of the trade-offs between guaranteed 
robustness and performance. 

The robust control synthesis approach is closely related to the homotopy tech- 
niques discussed by Richter [136] for the design of reduced-order 'H 2 controllers. In 
one formulation of these homotopy problems, the parameter to be varied is written in 
terms of the initial and final values, and a homotopy variable A £ [0, 1]. For example, 
in this problem we could write 

Mi(X) = Mu + X(Mif — Mu), (5.51) 

so that Mi(0) = Mu and Mi(l) = Mi/. The solution vector x can then be parame- 
terized in terms of the variable A. The solution algorithm employed here is a zeroth 
order homotopy algorithm, because the current optimal solution vector x(A) is not 
updated in the outer loop to account for changes in A [37,38,109,136]. 

Several homotopic continuation algorithms have been developed for the related 
class of reduced-order ‘H 2 controllers [38,109]. These algorithms employ linear updat- 
ing schemes for the current solution vector using the derivative of the solution with 
respect to A to obtain 

dec 

z(A + aA) = s(A) + aA— . (5.52) 

This approach has proven to be an effective solution technique provided that suitable 
homotopy parameters can be isolated for the problem of interest. With several sim- 
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pie examples, Mercadal [109] demonstrates that choosing internal plant parameters 
( e.g. spring stiffnesses or subsystem coupling levels) can lead to poorly conditioned 
homotopy solution paths. However, Collins [37] has recently reported good success 
with a homotopy on the control authority and sensor noise. 

A linear prediction homotopy algorithm has been applied to the optimal Popov 
analysis problem, but this level of sophistication was not found to be necessary for 
the examples in the next two chapters. Recent results by Collins et al. [38] compare 
various prediction techniques on a low order system (n = 8). Compared with an 
approach that uses no prediction, the linear prediction scheme improves the numer- 
ical conditioning of the homotopy path and reduces the overall computational time. 
However, a critical issue in implementing this update approach is the feasibility of 
computing and inverting the Hessian matrix to determine dx/dX. With 300-500 de- 
grees of freedom in the optimization for the SISO and MIMO examples discussed in 
Chapter 7, the computational effort for each outer loop step is enormous. Collins 
also reports that quasi-Newton approximations for this Hessian often result in poorly 
conditioned updates. Unfortunately, determining a good solution technique for this 
related problem of optimal reduced-order 7^ 2 controllers is an issue that extends well 
beyond the scope of this thesis. 

There are several interesting features of the solution algorithm. For instance, 
each of the inner loop gradient steps requires the solution of two (n + n c ) x (n + n,,)^ 
order equations: a Riccati equation for P and a Lyapunov equation for Q. The “A” 
matrices of these two equations are strongly related. If Ap, denotes the “A” matrix 
for the P equation, then the “A” matrix for the Q equation is Aq = Ap + BoR^B^P. 
From the structure of this coupling, if there exists a nonnegative definite matrix P 
that solves the Riccati equation, then Aq is known to be stable. This can be seen 
from the Hamiltonian matrix used to determine P 


H = 


' Ap BqRq 1 Bq ' 

. -Q* ~ a p _ ' 


(5.53) 
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Following the approach in Francis [54], this Hamiltonian matrix is transformed using 


T = 


I 0 
P I 


(5.54) 


to form H 2 = T~ l HT. Then, if P solves the Riccati equation A'pP + PAp + Qp + 
P BqR^ 1 Bq P = 0, H 2 can be rewritten as 


Hi = 


Ap + Bo R q 1 Bq P BoRo Bq 

0 -{Ap + B 0 R^ 1 B^P) T 

Aq BqRq Bq 


0 


-A T - 

a q 


(5.55) 

(5.56) 


So, if there exists a nonnegative definite P that solves this Riccati equation, then Aq 
is stable. Then, with the detectability assumption, this implies the existence of a non- 
negative definite Q that solves the corresponding Lyapunov equation. Consequently, 
only two main error flags need to be checked during the line search of the inner loop 
optimization. The first flag checks that the compensator stabilizes the nominal sys- 
tem. The second checks that a positive definite P solution exists for Eq. 5.26, which 
indicates that the closed-loop system satisfies the criteria for robust stability. When 
both of these conditions are satisfied, the Lyapunov equation is solved for Q , and the 
overbounding cost function and gradients are computed. 

Good initial guesses for this nonlinear, non-convex optimization problem are es- 
sential because of the presence of local minima. For small values of M\ and M 2 , 
an initial guess can be found from an iterative solution of Eqs. 5.39-5.42. Con- 
sider the full order case in which t± = 0 and Eq. 5.42 is eliminated. The ma- 
trix P a can be written in terms of P using Eq. 5.35, which implies that Eq. 5.39 
can be written as a standard Riccati equation in P. However, the two remaining 
equations are strongly coupled by terms in the “ A ” matrices. In Eq. 5.40, there 
is a term of the form \Ap + BoR^ 1 Bq P] + BoRq 1 Bq P , and in Eq. 5.41, there is 
Ap = [Ap + BoR^ 1 Bq P] - QS. For given values of N 0 , H 0 , Mi, and M 2 , we first 

A 

solve for P. Combining this solution and a given Q o, we then determine Pq. The 
values for P and P 0 are in turn used to solve for Qi- The sequence is continued, and 
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the convergence is checked with the error e 3 = max(||<3; - Qi- 1 || 2 , ||Pi - A-il^)- If 
convergent, the iterations are terminated when e s is sufficiently small. 

The best selection of the initial Qq matrix is an open question. One approach is 
just to use the Q solution matrix from the LQG design. Since controllers are being 
developed for a whole range of control authority and robustness values, the P and Q 
matrices from previous designs can also be used as an initial guess. Unfortunately, 
as with many iterative solution techniques for nonlinear optimization problems, con- 
vergence of the sequence outlined above is not guaranteed. For higher order prob- 
lems, more sophisticated approaches to the design of initial conditions were employed. 
These were based on the sensitivity weighted [30] and multiple model [59] controllers 
discussed in the Introduction. The overall design sequence then results in a unified 
approach to robust control design, with each step providing further guarantees in the 
robustness of the controller. 

There are extra degrees of freedom in the solution algorithm that are associated 
with the No and Hq matrices. The elements of these matrices must be picked using the 
known values of M 2 and M\. The numerical results from the examples in Chapters 6 
and 7 indicate that it is quite simple to select these multiplier matrices to obtain 
controllers that stabilize the system with large initial guarantees. 

An extremely important feature of this design process is that the synthesis ap- 
proach is virtually insensitive to the number of uncertain parameters. Consider the 
multiple model approach to robust control [59] . The addition of each new uncertainty 
could potentially require that several new models of the system be included in the 
optimization of the controllers. Adding new models significantly increases the compu- 
tational effort, but leaving them out results in even fewer guarantees of stability. For 
the algorithm in this thesis, each new uncertainty requires that additional multiplier 
states be included in the system matrices. However, this only increases the system 
size by the order of the multiplier. Of course, for the case in this chapter, where no 
augmentation is required, the only change is two extra degrees of freedom in s. In 
practice, it was found to be quite simple to add extra uncertainties to the system as 
the control designs evolved to the final M\ and M 2 values. 
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Another important feature of the technique is the flexibility of both upper and 
lower stability bounds. The values of Mi and M 2 can be changed independently to 
account for any known biases in the uncertainties. The examples in the next two 
chapters will show that many systems exhibit a “stiff” uncertainty direction that is 
more difficult than the rest. This additional flexibility in the selection of Mi and M 2 
can be used to tailor the uncertainty bounds to account for these directions. 

For the experiments, a family of robust controllers is typically developed for several 
values of control weighting p. One successful technique for starting the optimization 
is to use an optimal design with Ruu — Pi > P2 as an initial guess for controllers 
with Ruu = p 2 - A homotopy on the control (and possibly sensor noise) weighting 
Ruu is then performed to develop the optimal compensator with the desired values 
of Mi, M 2 , and p. Although this optimization was found to be well conditioned, it 
typically takes 3-7 times more gradient steps than an inner loop optimization step 
requires. The approach was found to be particularly effective for the reduced-order 
designs because it is often quite difficult to determine high authority controllers that 
satisfy both the robustness and order constraints. It is typically much simpler to find 
low authority designs that satisfy both of these conditions. 

A further consideration in the numerical solution for the optimal controller is the 
parameterization of the A c matrix in Eq. 5.14 [38,109]. As is well known, a state space 
representation of the controller is only unique to within a similarity transformation. 
Furthermore, the selection of a canonical form for the compensator representation 
can significantly reduce the number of free parameters in the optimization. As a 
result, the computational effort required for each optimization step is also reduced. 
However, reducing the number of free parameters does not guarantee that the so- 
lution will converge more quickly, because constraining the parameterization of the 
compensator may introduce local minima into the problem and adversely affect the 
conditioning of the solution. Extra degrees of freedom in the compensator result 
in a solution hyperplane rather than a single point, and as a result, the problem is 
poorly conditioned near the minimum. MacMartin [105] suggests switching between 
different parameterizations of the controller depending on the progress of the solution 
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procedure. A canonical form with fewer degrees of freedom should be used near the 
optimal solution. Unfortunately, determining when to switch between the different 
representations of the controller is often quite difficult. 

Mercadal [109] and Collins et al. [38] suggest a tridiagonal A c with arbitrary B c and 
C c as a good compromise between reducing the computational effort and maintaining 
a well conditioned solution. To take advantage of the better conditioning of the 
solution, no controller parameterization is used in the low order designs in Chapter 6. 
The higher order compensator designs in Chapter 7 are tridiagonal. 

In the development of the stability criteria in Chapter 3, the multiplier matrices 
H 0 and No were constrained to be positive definite and nonnegative definite respec- 
tively. The solution of the optimization problem must be constrained to ensure that 
these conditions are satisfied. Scales [144] suggests the barrier function technique 
for nonlinear minimization problems with inequality constraints. Logarithmic barrier 
functions were selected for this work. The cost function is augmented with functions 
that penalize the constrained state values as they approach the boundary. The barrier 
functions are augmented to the cost J(x ) to obtain 

$k(x,a k ,Pk) = J{x) - a* log(det if 0 ) - /3jfclog(detlVo), (5.57) 

which is then used as the objective function in an unconstrained optimization problem. 
The gradients of the Lagrangian with respect to N 0 and H 0 in Eqs. 5.48 and 5.49 
are modified to account for the extra terms in Eq. 5.57 using the derivatives from 
Athans [9]. As any of the elements of Hq or N 0 approach the boundary at 0, — > oo. 

The magnitude of a*, and fik determine the relative importance of the inequality 
conditions on H 0 and No- 

Further safeguards must be incorporated into the line search in this case to ensure 
that no inadmissible values of No and Ho are accepted. One element of Hq is typically 
fixed, and the other values of Ho and No are scaled relative to this number. It is 
interesting to note that, in the examples considered in the next two chapters, the 
optimal solutions for Hq and No were found to be positive. Consequently, there was 
no need to enforce these constraints on their definiteness. 
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Most of the previous issues were concerned with numerical aspects of robust con- 
trol design. There are also some very important experimental implementation issues. 
In particular, the stability of the compensator is important because the resulting 
closed-loop system is conditionally stable. Unstable controllers have been success- 
fully implemented on hardware at the Space Engineering Research Center at MIT. 
However, if they are to be used reliably in future systems, several additional safety 
measures must be incorporated into the software of the computer that runs the control 
design, known as the real-time computer. 

Several authors [55,73,76,93,151] discuss ways to avoid this problem of unstable 
compensators. One such technique is to penalize the 77 2 norm of the controller in the 
objective function. As with the barrier functions, the coefficient of this additional 
cost term determines the importance of the controller constraint, i.e. how close the 
compensator poles lie to the line of instability. Other tests can be used to constrain 
the placement of the compensator poles using more complicated geometric shapes [68]. 

An important issue in the numerical design of robust controllers is the conver- 
gence of the solution algorithm to a global minimum. The problems with the D-K 
iteration for /z synthesis were discussed in the Introduction. As the name suggests, 
the solution algorithm consists of an iteration between multiplier evaluation (D) and 
Hoo controller design (K). Since the iteration sequence is non-convex, it may result 
in a suboptimal solution at a local minimum. The first part of this iteration requires 
that the scaling functions be found by solving a series of convex minimization prob- 
lems. These functions are then approximated using a curve-fitting procedure [117]. 
As a result, the transfer function D(s) can be written in state space form and aug- 
mented to the system to continue the synthesis process. However, as discussed by 
Safonov and Chiang [141], there is little indication of the sensitivity of the synthesis 
approach to errors in the approximate curve-fitting step. A further important point is 
that the curve-fitting is performed during each iteration step. The process is further 
complicated in mixed ft synthesis because there are now two scaling functions [170]. 

It was shown in Sections 3.4 and 3.6 that the multiplier W(s) corresponds to 
a particular parameterization of these scaling functions. A key difference in the 
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combined H 2 /real fi approach in this thesis over fi synthesis is that the approximations 
on the order and representation of the scaling functions are made at the beginning of 
the synthesis process, not during each synthesis iteration. Moreover, the frequency 
domain tests in Section 3.4 and 3.6 provide qualitative measures of the conservatism 
in these approximations. The K m synthesis discussed in Section 3.9 also avoids this 
curve-fitting step, but it still results in an iterative solution algorithm. 

As with other state space optimization techniques, there are no guarantees that 
the optimal solution of the robust control algorithm outlined in this section is not at 
a local minimum. Furthermore, there are no guarantees that the homotopy to the 
desired stability bounds can be achieved. The only recourse for the designer is to 
try several initial conditions and select the best of the converged designs. In spite 
of these apparent difficulties, the results in this thesis clearly demonstrate that the 
algorithm can be used to design robust controllers for high order, complex systems 
with multiple parameter uncertainties. 

The synthesis approach offers several distinct advantages over the fi and K m syn- 
thesis techniques. The approach permits the designer to pre-specify the compensator 
order and architecture so that an optimal design with these extra conditions can be 
obtained. These design specifications cannot be incorporated into the standard Tioo 
synthesis problem, but are critical for most realistic problems. Furthermore, the al- 
gorithm does not require an explicit iteration between the multiplier evaluation and 
control design because the optimal values of both are obtained simultaneously. 

5.4 Summary 

This chapter investigates the design of robust controllers using analysis tests based 
on the Popov stability multiplier. The resulting necessary conditions simultaneously 
yield the optimal controller and multiplier values. The optimal compensators guar- 
antee robust stability for a given class of time-invariant sector-bounded uncertainties. 
By minimizing a worst case 7f 2 performance bound, these designs also achieve robust 
performance. A numerical algorithm is presented to solve the optimality conditions 
in Theorem 5.3, Eq. 5.48, and Eq. 5.49. The analysis results in Chapter 3 also indi- 
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cate that this synthesis technique can be applied to the robust control problem with 
linear and nonlinear real parameter uncertainties. The following two chapters use 
this combined 7f 2 / re a 1 fi approach to design robust Popov controllers for low order 
benchmark problems and more complicated experiments. 
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Chapter 6 


Numerical Synthesis Examples 

6.1 Introduction 

The goal of this chapter is to present examples of optimal robust controllers devel- 
oped using the Popov synthesis algorithm discussed in Chapter 5. Robust controllers 
are designed for two simple systems with constant real parameter uncertainties. The 
analysis in Chapter 3 and Refs. [39,69,143] indicates that, for systems with constant 
real parameter uncertainties, the approach in this thesis is less conservative than 
equivalent tests developed using bounded gain and positive real uncertainty mod- 
els. The aim here is to extend these analysis results by considering optimal robust 
controller synthesis. 

Two benchmark problems with constant real parameter uncertainty are considered 
in order to demonstrate the importance of analysis methods that restrict the time- 
variation of the system uncertainty. The first is the two mass spring system shown in 
Fig. 6.1. The second is the coupled four disk system from Ref. [31] shown in Fig. 6.2. 

For the system in Fig. 6.1, the uncertainty enters the plant through errors in the 
spring connecting the two masses. For the system in Fig. 6.2, uncertainty in the inertia 
of disk 1 is considered first. The problem is then reformulated to capture multivariable 
uncertainty in the stiffness values of the springs k 3 and k 3 . The inertia uncertainty 
in the second system is complicated because it influences all three flexible modes of 
the system and can result in the poles and zeroes exchanging order, as illustrated in 
Fig. 6.3. The sensitivity of the plant transfer function to parameter variations makes 
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Figure 6.1: Two mass oscillator. 



Figure 6.2: Four disk oscillator. 

this four disk system a difficult challenge for robust control design [31,42]. 

Both full and reduced-order controllers are developed in this chapter, but no con- 
sideration is given to the potential problem of higher frequency unmodelled dynamics. 
Frequency weighted cost functionals in the specification of the H 2 problem can be 
used to address this unstructured uncertainty. The results are presented in terms of 
performance robustness curves or “buckets” for several values of the stability bounds 
Mi and M 2 . Also, where possible, an interpretation of how this robustness is achieved 
is also presented. Recall from the previous developments that M\ and M 2 represent 
the guaranteed robust stability bounds, which are lower bounds on the magnitude of 
the actual stability limits achieved. 


122 







Figure 6.3: Transfer function from force actuator to angle sensor for 
the four disk oscillator, demonstrating the influence of 
inertia perturbations to disk 1 (ml) on the order of the 
poles and zeroes. 


6.2 Two Mass Spring System 

Consider the two mass spring system illustrated in Fig. 6.1 with mi = m 2 = 1 and an 
uncertain spring stiffness k. A control force acts on mass 1, and the position of mass 2 
is measured, resulting in a noncollocated control problem. The nominal dynamics, 
with the states defined in the figure, are then governed by the matrices 


A = 


0 0 10 
0 0 0 1 
-K om ^nom 0 0 
K. om ^nom 0 0 



'O' 


'0 O' 


0 


0 0 

, B = 


, D x = 



1 


0 0 


.0. 


.! 0. 


C = [0 1 0 0 ] , (6.1) 


and D 2 = [0 1]. The actual spring stiffness can be written as k = om + A k, 
where A^ om = 1. The actual dynamics of the system are given by the matrix Ak = 
A — AkBoCo, where Co = [ 1 —1 0 0 ] and Bq = — [ 0 0 —1 1 ]. Note that with 
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this stiffness uncertainty, CqBq = 0. The simplifications in the synthesis procedure 
resulting from this observation are discussed in Remark 5.2. 

The benchmark problem is discussed in detail in Ref. [164]. The following example 
only considers design problem 1: 

Design Problem 1 (Ref. [164]): Design a constant linear feedback compensator 
of the form 

x c (t) = A c x c (t ) + B c y{t) (6.2) 

u(t) = C c x c (t ) + D c y(t) (6.3) 

with the following properties: 

(i) The closed-loop system is stable for m\ — m 2 = 1 and 0.5 < k < 2.0. 

(ii) For w(t) = unit impulse response at t=0, the performance variable z = x 2 has 
a settling time of about 15 seconds for the nominal system mi = m 2 = k = 1. 

(iii) The control system can tolerate reasonable measurement noise signals. 

(iv) The control system achieves reasonable performance/stability robustness with 
reasonable bandwidth. 

(v) The control system uses reasonable control effort and complexity. □ 

For this example, the displacement of mass 2 was penalized, so Rx X = C T C, 
V 2 = Ruu = p, and Vi = DiD^, where p = 0.001. The goals are to achieve good 
nominal performance and demonstrate robust stability and performance for perturbed 
spring stiffness values in the range 0.5 < k < 2. 

Using the algorithm in Section 5.2, several full- order (n c = n) Popov compensators 
were designed for this uncertain system. The designs axe distinguished by the labels 
“Popov(a)(b)”, where (a) refers to the number of the example, and (b) refers to the 
different compensators for that example. Two robust designs are compared with the 
optimal LQG controller in Fig. 6.4. The stability robustness and performance levels 
achieved are presented in Table 6.1. As mentioned earlier, there are no guaranteed 
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Figure 6.4: Performance cost curves illustrating the trade-off be- 
tween guaranteed (and achieved) robust stability and 
nominal/robust performance. See Table 6.1 for stabil- 
ity bounds. 

stability robustness bounds for the LQG design. The costs have been normalized with 
respect to the optimal LQG value to obtain J norm . 

As is apparent from Fig. 6.4, the lower stability limit is the more challenging 
goal to achieve. The Popovl2 compensator guarantees stability for stiffness values 
in the range (—0.4, 0.6), but achieves robust stability over the range of stiffness val- 
ues specified in problem 1. The optimal multiplier for the Popovl2 compensator is 
W(s) = 1 + 0.33s. 

The optimal Popovl2 and LQG controllers are compared in Fig. 6.5 and Ta- 
ble 6.2. While similar at high frequencies, the compensators are strikingly different 
for frequency values near the uncertain mode. The more lightly damped nonmini- 
mum phase zero in the Popov compensator at 0.9 rad/sec phase stabilizes the system 


125 




Table 6.1: Closed-loop robust performance for the two mass system 
with spring uncertainty. 


Fig. 6.4 

*7norm 

Lower stability bound 

Upper stability bound 

Label 


achieved 

guaranteed 

guaranteed achieved 

LQG 

1.00 

-0.03 

0 

0 

0.45 

Popovll 

1.42 

-0.25 

-0.10 

0.30 

0.95 

Popovl2 

3.34 

-0.55 

-0.40 

0.60 

1.05 


Table 6.2: Comparison of LQG and Popovl2 compensators for the 
two mass system. 


Compensator 

Gain 

Poles 

Zeroes 

LQG 

-1.28 

-1.76 ± 4.26J 

-0.65 

-4.98 ± 3.42; 

0.15 ± 1.23; 

Popov 12 

-0.36 

-7.16 ±0.88; 
-3.63 ± 6.23; 

-0.29 

0.04 ± 0.93; 


for negative values of A k. Similarly, the phase of the Popov compensator is higher 
at high frequencies, leading to a stable system for larger positive values of Ak. A 
comparison of the modifications required for the Popov compensator at high and low 
frequencies clearly illustrates why the lower stability limit presents the more difficult 
design challenge. 

The robustness of the two compensator designs can be compared further in terms 
of the gain and phase margins of the loop transfer functions. With the LQG compen- 
sator, the phase margin at 0.98 rad/sec is only 4° and gain margin at 1.00 rad/sec is 
only 1.06. With the Popov compensator, the phase margin at 2.02 rad/sec is 37° and 
the gain margin at 3.53 rad/sec is 2.5. 

The impulse responses in Fig. 6.6 are presented to address the robust performance 
and control effort issues in problem 1. These figures compare the responses for the 
closed-loop systems with nominal and perturbed stiffness values. The degradation 
of nominal performance to achieve a larger stability region is shown by the plots on 
the left. Note that the Popovl2 compensator meets the performance specification of 
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Figure 6.5: Comparison of LQG and Popovl2 compensators for the 
two mass system, illustrating the phase stabilization of 
the Popov controller. 

15 sec, but the transient response of mass 2 is worse than that achieved by the LQG 
design. However, the plots on the right illustrate that similar levels of performance 
are achieved by the Popov compensator, even at the limits of guaranteed stability. 
Fig. 6.4 clearly shows that the LQG controller destabilizes the system for these values 
of the parameter errors. The two lower plots demonstrate that the Popov compensator 
does not require significantly increased control authority over the LQG design. 

The open and closed-loop pole locations for the two mass system with LQG and 
Popov compensators are presented in Fig. 6.7. These graphs show the no mi nal closed- 
loop poles and, for the Popov designs, the poles at the limits of guaranteed stability. 
The closed- loop poles are given for several values of A k in the range (—0.75, 1.5). The 
extreme sensitivity of the LQG design can be seen by the rapid movement of the lowest 
frequency closed-loop pole into the right half plane. With the Popov compensator, 
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Nominal stiffness 


Perturbed stiffness 




Figure 6.6: Impulse responses for the two mass system with nominal 
and perturbed stiffness values. The nominal performance 
with the Popovl2 compensator meets the 15 sec settling 
time specification. Popovl2 performance degrades with 
perturbed stiffness values, but remains stable. 

the equivalent pole pair remain in the left half plane for much larger values of the 
parameter uncertainty. In fact, it is actually the higher frequency pole pair that is 
destabilized first. 

The modifications to the optimal 7^2 compensator as the requested stability bounds 
are increased are shown in Fig. 6.8. These figures give the poles and zeroes for the 
LQG controller and several Popov designs. For this uncertainty set, as Mi and M 2 
are increased, the trend is towards more heavily damped compensator poles and more 
lightly damped compensator zeroes. 

This simple example serves to illustrate that the Popov synthesis technique results 
in robust controllers that achieve good guaranteed robust performance. The following 
sections investigate the design approach for more complicated systems. 
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Figure 6.8: Compensator pole and zero locations as a function of 
increased robustness guarantees. The arrows indicate the 
trends with increasing M 2 . 
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6.3 Coupled Rotating Disk System 

We can extend these results and observations by considering two versions of the 
more complicated four disk problem. A state space model for the four disk system 
illustrated in Fig. 6.2, with states associated with the angular positions of each disk, 
is given by the matrices 


A = 


0 I 

-J~ l K —J~ l D 


and D 2 = [0 1], where 


J = m 


0.5 0 0 0 
0 10 0 
0 0 10 
0 0 0 1 


, B = 


,K — k 


' 0 ■ 


‘O' 


' 0 

O' 

0 


0 


0 

0 

0 


0 


0 

0 

0 

0 

, C T = 

1 

0 

, D,= 

0 

0 

0 

0 



0 


0 

0 

0 


0 


0 

0 

. 0 . 


0 


x 

* m 

0 


1-10 0 
-1 2-1 0 
0-1 2-1 
0 0-11 


,D = d 


1-10 0 
-1 2-1 0 
0-1 2-1 
0 0-11 


(6.4) 


, (6.5) 


m = k = 1, and a low damping value of d = 0.01 is used. The inertia of disk 1 (mi) is 
considered to be uncertain in Part 1 of this problem. However, the inertia parameter 
enters the system dynamics through its inverse. Consequently, we will consider an 
uncertainty rh in the inverse of the inertia, which can be represented as 


l/T7Zl — 1 / TTtrinm ”1“ m, TTUnn- m — 0.5. (6.6) 

Then, as rrti varies from 1 to 0.25, m varies from —1 to 2. The uncertainty in the 
dynamics matrix A can then be represented as a A = —rhBoCo, where 

■Bo* = “ [ 0 0 0 0 1 0 0 0 ] , C Q =[-k k 0 0 -d d 0 0 ] . (6.7) 

Part 2 of this design considers uncertainties in the stiffness values of the springs 
ki and k 3 . Several characteristics make this problem important in the design of 
controllers for lightly damped structures. As shown in Fig. 6.9, the performance is 
dominated by the rigid body and first flexible modes, which are essentially unchanged 
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Figure 6.9: Influence of stiffness uncertainty on tlie transfer function 
for the four disk problem. The two uncertainties are as- 
sumed equal in the analysis. For a lightly damped sys- 
tem, 5% uncertainty in both stiffness values can result in 
plant phase variations of ±100°. 


by the model uncertainty. Furthermore, the two higher frequency modes and the zero 
at 1.4 rad/sec are highly uncertain, resulting in large phase uncertainties in the system 
with only 5% variations in the two stiffness values. The uncertainty in the dynamics 
matrix A can be represented as a A = —BqaKCq, where 



0000 -2 1 00 
0 0 0 0 0 0 -1 1 


, C 0 = 


1 -1 0 00000 
0 0 1 -1 0 0 0 0 ’ 


( 6 . 8 ) 


and a K = diag(Aifci, A k 2 ). To complete the noise and performance specifications for 
the 7^2 synthesis, we define R xx = C^Ci, V 2 = Ruu = P, and Vi = DiD^ , where 
p = 0.005 and C x = [0 0 0 1 0 0 0 0.1]. 

The results for Part 1 are given in Fig. 6.10 and Table 6.3 . The synthesis sequence 
was terminated at guaranteed bounds of i0.16, but the achieved stability limits are 
actually —0.22 < rh < 0.34. These actual limits correspond to inertia values in the 


132 




Inverse inertia uncertainty 

Figure 6.10: Closed-loop robust stability and performance with inertia 
uncertainty in disk 1. See Table 6.3 for stability bounds. 


Table 6.3: Closed-loop robust performance with inertia uncertainty 
in disk 1. 


Fig. 6.10 
Label 

*^norm 

Lower stability bound 
achieved guaranteed 

Upper stability bound 
guaranteed achieved 

LQG 

1.00 

-0.009 

0 

0 

0.041 

Popov21 

1.32 

-0.110 

-0.089 

0.021 

0.151 

Popov22 

1.58 

-0.160 

-0.115 

0.115 

0.250 

Popov23 

1.80 

-0.220 

-0.159 

0.159 

0.340 


range 0.43 < mi < 0.56. This range represents a significant fraction of the variation 
(mi ~ 0.38) at which the poles and zeroes change order in Fig. 6.3, and a substantial 
improvement over the LQG result. The penalty in terms of performance degradation 
is evident from the J nonn values in Table 6.3. 

The robust control synthesis procedure for Part 2 assumes that the two stiff- 
ness uncertainties are uncorrelated. For simplicity in the analysis, the case with 
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Figure 6.11: Closed-loop robust stability and performance with two 
stiffness uncertainties. It was assumed that Ak\ = Ak 2 
for the analysis. See Table 6.4 for stability bounds. 

Aki = Ak 2 is considered here. The robust stability and performance results are 
presented in Fig. 6.11 and Table 6.4. The Popov33 compensator guarantees stability 
for 5% independent variations in the stiffness values, wbicb represents a significant 
improvement over the values that the LQG design actually achieves. For this lightly 
damped system, these perturbations correspond to approximately ±100° phase vari- 
ations in the plant. 

In these synthesis problems, there typically is a “stiff” uncertainty direction that 
is more difficult than the other directions. The negative uncertainty values are more 
difficult to achieve in this example, as can be seen by the closeness of the guaranteed 
and achieved lower bounds in Table 6.4. While the discrepancy in the guaranteed 
and achieved upper bounds is, to some extent, a measure of the conservatism in the 
technique, it is also a reflection of the relative ease of robustifying the system to this 
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Table 6.4: Robust stability and performance for the closed-loop sys- 
tem with two stiffness uncertainties. It was assumed that 
A&i = Ak 2 for the analysis. 


Fig. 6.11 
Label 

•^nonn 

Lower stability bound 
achieved guaranteed 

Upper stability bound 
guaranteed achieved 

LQG 

1.00 

-0.003 

0 

0 

0.028 

Popov31 

1.12 

-0.025 

-0.019 

0.019 

0.060 

Popov32 

1.25 

-0.045 

-0.035 

0.035 

0.100 

Popov33 

1.38 

-0.063 

-0.051 

0.051 

0.140 


particular direction of the uncertainty. 

The transfer functions of the optimal LQG and Popov33 compensators are com- 
pared in Fig. 6.12. The uncertainty in the zero-pole combination at approximately 
1.4 rad/sec is reflected in the Popov compensator by lower compensator gains and 
much smoother phase. The optimal multiplier for Popov33 is W opt (s) = diag(l + 
0.16s, 2.9(1 + 0.27s)). 

Further comparisons of the LQG and Popov designs are given in Figs. 6.13 and 
6.14. In each figure, the lower plot magnifies the region of the complex plane about 
the Imaginary-axis. The figures show the open-loop and closed-loop pole locations of 
the system as a function of the uncertainty A k = A k x = A k 2 for —0.2 < Ak < 0.2. 
The LQG and Popov33 designs from Table 6.4 are compared in these figures. The 
two sets of closed-loop poles are plotted for the same values of Ak. The graphs also 
indicate the nominal pole locations. If applicable, the pole locations at the guaranteed 
stability limits are also identified. 

With the LQG compensator in Fig. 6.13, there are nominally two closed-loop poles 
at approximately 1.4 rad/sec, the frequency of the plant zero. Further analysis of 
Fig. 6.13 indicates that the more lightly damped of these two pole pairs is extremely 
sensitive to changes in the stiffness values. This rapid destabilization is expected, 
given the large system changes in this frequency range shown in Fig. 6.9. 

A similar examination of the closed-loop poles with the Popov compensator in 
Fig. 6.14 indicates that several key changes have occurred. While the three lowest 
frequency poles are more heavily damped, the highest frequency one is essentially un- 
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Figure 6.12: Optimal LQG and Popov33 compensator comparison for 
the system G(s) with two stiffness uncertainties. 

changed. The additional robustness of the closed-loop system to stiffness uncertainty 
is clearly evident from the traces in Fig. 6.14. 

To demonstrate the changes that have occurred to the robust controllers, the 
compensator poles and zeroes are plotted in Fig. 6.15 as a function of the desired 
stability bounds. Although complicated, the figures illustrate that, in this case, the 
Popov compensator poles and nonminimum phase zeroes are more heavily damped 
than their LQG counter part. This conclusion is consistent with the observation 
that the compensator phase is much smoother than the LQG design. Also evident 
is the fact that the real minimum phase zeroes of the Popov compensators are at 
lower frequencies. Furthermore, note that the compensator pole at approximately 
1.4 rad/sec is shifted away from the plant zero in the Popov designs, which means 
that they avoid pole-zero cancellations in the closed-loop systems. 
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le locations with the Popov33 compen- 
Afci = A k 2 and —0.2 < A k < 0.2. 

L38 









Imaginary Imaginary 



Figure 6.15: Compensator pole and zero locations for increasing guar- 
anteed stability bounds. The arrows indicate the trends 
with increasing M 2 . 
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Normalized cost 



Correlated stiffness uncertainty 

Figure 6.16: Closed-loop robust stability and performance with two 
stiffness uncertainties. Comparison of full (n c = 8) and 
reduced-order (n c = 6) designs. It was assumed that 
A ki = Ak 2 for the analysis. See Table 6.5 for the corre- 
sponding stability bounds. 


Table 6.5: Closed-loop robust stability and performance with two 
stiffness uncertainties. Comparison of full (n c = 8) and 
reduced-order (n c = 6) designs. It was assumed that 
A ki = A k 2 for the analysis. 


Fig. 6.16 
Label 

*7norm 

Lower stability bound 
achieved guaranteed 

Upper stability bound 
guaranteed achieved 

LQG 

1.00 

-0.003 

0 

0 

0.028 

Popov n c = 8 

1.17 

-0.033 

-0.024 

0.024 

0.075 

Popov n c = 6 

1.27 

-0.035 

-0.025 

0.025 

0.200 
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Phase Magnitude 




Figure 6.17: Full (Gpc8) and reduced-order (Gpc6) Popov compen- 
sators for the system with two stiffness uncertainties. See 
Tables 6.5 and 6.6. 


Table 6.6: Comparison of a full (Gpc8) and reduced-order (Gpc6) 
Popov compensator for the system with two stiffness 
uncertainties. Stability boundaries are provided in Ta- 
ble 6.5. 


Compensator 

Gain 

Poles 

Zeroes 



-0.02 ± 1.40; 

-0.26 

Popov n c = 8 
Gpc8 

-0.36 

—0.31 ± 2.35.7 
-2.18 ±1.51; 

0.17 ±0.80; 
0.08 ± 1.60; 



-2.41 ± 2.85; 

-0.03 ± 1.97; 

Popov n c = 6 
Gpc6 

-0.34 

-0.02 ±1.40; 
-0.85 ± 0.98; 

-0.27 

0.17 ±0.83; 


-2.03 ±7.15; 

0.06 ± 1.65; 
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To complete the discussion of this problem, a reduced-order Popov controller 
(n c = 6) is given for Part 2. The stability robustness and performance values are 
given in Fig. 6.16 and Table 6.5. Since the optimal compensator order is n c = n = 8, 
the nominal performance of this suboptimal design (n c = 6 < n ) is expected to be 
worse than both the LQG and full-order Popov designs. This is clearly evident in the 
table by the larger value of J n 0 rm- Although Fig. 6.16 apparently indicates that the 
reduced-order design is more robust to increases in the stiffness values, this conclusion 
may not be valid for other combinations of A k\ and A^. 

The poles and zeroes of the full and reduced-order controllers are compared in 
Table 6.6, and the two compensator transfer functions are given in Fig. 6.17. Both 
sets of results indicate that the controllers are quite similar up to approximately 
1.5 rad/sec. However, the two designs differ at higher frequencies due to the reduced 
number of compensator poles and zeroes. The reduced-order design loses a pole in 
the 2. 5-3. 5 rad/sec range and the zero at 2 rad/sec. The loss of the phase recovery 
associated with this zero is accounted for in the reduced-order design by moving the 
highest frequency pole pair to approximately 7 rad/sec. 

6.4 Summary 

The results from these three examples illustrate the capabilities of Popov controller 
synthesis for robust control design with constant real parameter uncertainty. Further- 
more, the curves in Figs. 6.4, 6.10, and 6.11 illustrate the tradeoffs between robust 
stability and performance. From the relative flatness of the cost curves, it is clear 
that similar performance levels are achieved for all parameter variations in the range 
of guaranteed stability, as demonstrated by the impulse responses in Fig. 6.6. 

The last example is considered to be the most important of the three. This 
lightly damped benchmark problem captures many of the difficulties in the control 
of structures. The importance of these benchmark problems is that they clearly 
illustrate how the robustness is achieved. By considering a more complicated system, 
the results of the next chapter demonstrate that the approach is also effective for 
realistic systems. 
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Chapter 7 


Experimental Implementation 

7.1 Introduction 

This chapter considers the design and implementation of robust controllers for the 
Middeck Active Control Experiment (MACE). The goals of these experiments are 
to demonstrate the feasibility of Popov controller synthesis for higher order systems 
and to illustrate the capabilities of the design approach for complex systems with 
multiple uncertainties. In particular, a robustness problem with the experimental 
implementation of Linear Quadratic Gaussian (LQG) controllers is identified. It is 
then demonstrated how this problem can be solved using the more robust Popov 
controller synthesis technique described in Chapter 5. 

The discussion in this chapter focuses on the modifications to the compensators 
that are required to achieve this additional robustness. In particular, the controllers 
developed using Popov synthesis are directly compared with the optimal LQG designs. 
The tools from Chapter 6 are used to demonstrate the stability and performance 
levels that are achieved on MACE. The effectiveness of the Popov controllers is also 
demonstrated experimentally by intentionally changing the mass of the structure. 

Several design and implementation issues were encountered during these experi- 
ments. In particular, at high levels of control authority, the optimal compensators 
were found to be unstable. Unstable compensators result in conditionally stable 
closed-loop systems and thus require safeguards to be implemented reliably. This 
implementation issue is the subject of current research in the MACE program, so 
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Figure 7.1: Middeck Active Control Experiment (MACE) test article 
suspended in 1-g. 

only stable compensators were designed in this work. Recent experience indicates 
that noncollocated control problems result in unstable compensators at much lower 
levels of control authority. Consequently, the experiments in this chapter are of the 
“1-block” type [104]. In this case, the performance and sensed variables are the same, 
as are the control and disturbance inputs. Moreover, the system inputs and outputs 
are collocated. The discussion in this chapter concentrates primarily on the SISO 
experiment because of the insight that it provides to the robustification process. 

7.2 MACE Hardware Configuration 

The Middeck Active Control Experiment (MACE) is a Shuttle middeck experiment 
that is tentatively scheduled for flight in the summer of 1994 [111]. As illustrated 
in Fig. 7.1, the test article simulates a flexible spacecraft with several independently 
pointing payloads. The objective of the program is to investigate the extent to which 
closed-loop behavior in zero gravity (0-g) can be predicted through analysis and 
ground testing. Sensor noise, unmodelled high frequency dynamics, and the antic- 
ipated parameter changes due to gravity will all be major factors in the design of 
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Table 7.1: Properties of the MACE bus structure from [110]. 


Property 

Value 

Length (L) 

1.5 m 

Cross-sectional Area (A) 

2.25 x 10" 4 m 2 

Geometric inertia (I) 

1.4 x 10- 8 m 4 

Mass per unit Length (pi) 

0.27 kg/m 

Young’s Modulus (E) 

2.3 xlO 9 Pa 


controllers for MACE [43]. Previous flight experiments indicate that, in orbit, there 
will be large changes in the structural dynamics due to the absence of gravity [12]. 
Even with current prediction techniques, it is anticipated that these changes will 
result in large parameter uncertainties in the system model [134]. 

The first bending mode of the bus structure is at approximately 1.8 Hz, which is 
within the bandwidth of most payload pointing controllers [41]. If these compensators 
are designed with incomplete or inaccurate knowledge of the structural dynamics of 
the system, there is potential for an unstable interaction between the controllers and 
the bus structure. This phenomenon, known as Control-Structures Interaction (CSI), 
has been the subject of much recent research [57,92]. In particular, the Controlled 
Structure Technology (CST) approach has been developed at the M.I.T. Space En- 
gineering Research Center (SERC) [42] to address this phenomenon. A conclusion 
from this CST research is that, to achieve the stringent overall performance objec- 
tives on a test article such as MACE, the compensators must be designed to control 
the dynamics of the structure. The following is a brief description of MACE and the 
sensors and actuators that are required to control the device. 

The final configuration of the MACE hardware will consist of two articulating 
payloads mounted at either end of a 1.5 m long bus that is constructed from four 
Lexan tubes connected by aluminum nodes. The properties of the bus structure are 
given in Table 7.1. The orientation of each payload is controlled by a two-axis gimbal 
system, while the bus attitude is controlled by three torque wheels. Several sensors, 
including rate gyros, accelerometers, strain gauges, and angle encoders, are available 
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for performance evaluation and control feedback. The properties of these sensors and 
actuators are discussed in detail in Ref. [139]. Note that the three torque wheels must 
be combined to generate a torque about each axis in the figure [111]. The appropriate 
transformations for these torques were calculated from the design geometry. 

The experiments in this chapter use the torque wheel actuators and rate gyro sen- 
sors. The sensors are Bendix Cheshire 3-axis DC/AC rate sensors. Full sensor range 
is 75 degrees/sec, with a sensitivity of 0.04 V/(degree/sec). The natural frequency of 
the sensor is nominally at 48 Hz, with approximately 30% (of critical) damping. The 
noise specification for the device is 4 mV (rms) between 0-20 Hz. Several of the 1 kg 
rate gyro packages are attached to the structure. The experiments in this chapter 
use the package that is located on the middle node below the bus structure. The 
rate gyro electronics package includes a single pole low-pass filter with a 3 dB break 
frequency at about 80 Hz. The torque wheel actuators are connected by a base that 
is clamped to the top of the middle node. Each torque wheel weighs approximately 
1 kg. The combination of the base structure and the three wheels and motors weighs 
about 7.3 kg. The Aerotech DS8020 servo amplifiers and permanent magnet motors 
are rated at 0.029 Nm/Amp. The amplifiers have been modified so that they are 
current limited at ±10 Amps, with a peak output voltage of ±50 Volts. 

To facilitate ground testing of the hardware, the 27.8 kg test article is supported 
in 1-g by a three point active pneumatic/electric suspension system. The result- 
ing system dynamics then include two dominant suspension modes at approximately 
0.4 Hz and 0.8 Hz and several higher frequency “violin” modes that start at about 
6 Hz [138]. The hardware configuration in Fig. 7.1 is called the MACE Development 
Model (DM). The second payload in this configuration is a 7.1 kg dummy mass. 
A 40 mode finite element model of the DM test article was developed by Rey and 
Glase [135]. Table 7.2 gives the frequency, damping ratio, and mode type for each 
mode below 60 Hz. The damping was measured experimentally for all modes up to 
50 Hz, and assigned a nominal 1% value for higher frequency modes. 

The real-time computer for MACE is an AC100 with 16 digital, 16 analog, and 8 
encoder inputs and 16 digital, 8 analog, and 2 fast analog outputs [139]. The device 
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Table 7 . 2 : Frequency, damping ratio, and mode type for each mode 
in the finite element model of the MACE Development 
Model in the 0-60 Hz frequency range [135]. 


Frequency (Hz) 

Damping ratio 

Mode type 

0 

1 

Torque wheel #1 

0 

1 

Torque wheel #2 

0 

1 

Torque wheel #3 

0.20 

0.15 

Suspension - bounce 

0.22 

0.15 

Suspension - X-axis pendulum 

0.23 

0.15 

Suspension - Y-axis pendulum 

0.23 

0.15 

Suspension - Z-axis pendulum 

0.33 

0.08 

Suspension - tilt 

0.20 

0.15 

Suspension - 1 st twist 

1.21 

0.15 

Outer gimbal pendulum 

1.29 

0.05 

Inner gimbal pendulum 

1.86 

0.04 

1 st X-Y bending 

3.13 

0.04 

1 st X-Z bending 

6.72 

0.02 

2 nd X-Y bending 

6.87 

0.01 

2 nd X-Z bending 

8.85 

0.02 

Suspension - 2 nd twist 

9.40 

0.008 

3 rd X-Y bending 

13.29 

0.007 

3 rd X-Z bending 

14.00 

0.007 

4 th X-Y bending 

14.25 

0.007 

Suspension - 3 rd twist 

17.40 

0.006 

4 th X-Z bending 

36.00 

0.011 

Suspension - 4 th twist 

39.10 

0.02 

Suspension - 5 th twist 

42.50 

0.015 

5 th X-Y bending 

64.12 

0.01 

5 tk X-Z bending 
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includes two 80386 processors and one Weitek 3167 co-processor, which all operate at 
20 MHz. With one processor and co-processor, the computer can run a 24 state SISO 
compensator at 1 KHz, and a 59 state 3-input/3-output compensator at 500 Hz. 

The first step in designing controllers for this structure is to develop a model of the 
system. The controllers discussed in this chapter were designed using a state space 
model of the structure obtained from measured transfer functions. For the MIMO 
problem, the transfer functions for each of three disturbance inputs were identified 
separately and then combined using a reduction approach described by Gilpin [56]. 
Formal identification techniques are available to provide estimates of both the system 
parameters and their uncertainty [160]. 

As outlined by the component functional flow chart in Ref. [139], there are several 
connections required to measure a transfer function on MACE. The data for the model 
are obtained by applying band limited white noise (0-50 Hz) from a Tektronix Fourier 
Analyzer to an A/D input of the real-time computer. The signal is then transformed 
to produce a net disturbance torque about a particular axis. These three signals are 
then taken from the D/A (channels 1-3) and applied to the torque wheel motors 
through the amplifiers (1-3). The measurements from the rate gyro signal amplifiers 
(gain of 6) are passed through 8-pole anti-aliasing analog Bessel filters (3 dB break 
frequency at 150 Hz), and the output is then sent to the AC100. The AC100 input 
signals are then converted into estimates of the bus angle by 0.03 Hz second order 
(0.71 damping) stabilized integrators [111]. Finally, the signals are multiplied by a 
factor of 50 to reduce the quantization error in the fixed resolution D/ A conversion 
(12 bits for 20 Volts). The AC100 analog output is then measured by the Tektronix 
Fourier Analyzer. 

To obtain a disturbance torque about a particular bus axis, the output from the 
Tektronix Analyzer is sent to the AC100 before it is applied to the system. Since 
the control torques are generated in the AC 100, there is an extra time delay in the 
measured data that is not present in the loop to be closed. Consequently, the state 
space model must be designed to match the measured data that have been corrected 
to account for this extra delay. With a state space model of the structure, the design 
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Figure 7.2: Comparison of the 24 state model and measured data for 
the z-axis torque wheel to bus rate gyro loop. 

of SISO and MIMO robust controllers can now be presented. 

7.3 SISO Control Design and Implementation 

This section presents the results of the design and implementation of a robust SISO 
controller for the current MACE configuration, which is called the Development 
Model. As discussed, the SISO loop is between the z-axis bus rate gyro sensor 
and a combination of the three torque wheels as an actuator. The disturbance 
and control inputs are applied to the torque wheels through the transformation 
T z = [—0.817,0.408,0.408] to generate a net torque about the z-axis. Therefore, 
the loop is essentially between a collocated and dual sensor/actuator pair. The bus z- 
axis inertial angle is the performance variable, and the disturbances are added directly 
to the control signals in the AC100 real-time computer. 

Fig. 7.2 illustrates the accuracy of a 24 state model of this SISO system. The rate 
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gyro sensor dynamics, which consist of a highly damped pole pair at approximately 
48 Hz and a single pole at 80 Hz, are not explicitly modelled in this system. However, 
the curve-fit procedure resulted in two heavily damped poles at approximately 150 Hz. 
Since these sensor dynamics are well above the bandwidth of interest (about 20- 
30 Hz), this approximation is sufficiently accurate for these controllers, but higher 
bandwidth designs will need to model these sensor dynamics more completely. 

A 4-pole Pade approximation is included in the model to account for the com- 
putational time delay of 12.2 msec. Two suspension and seven flexible modes are 
observable in this transfer function up to a frequency of about 45 Hz. Five of the 
flexible modes are clumped around 10 Hz, and the other two are at 36 Hz and 42 Hz. 
The damping in these modes varies between 0.5% and 2.0%. Using the notation of 
Chapter 5, the 24 state model of the system can be written as 

x = Ax + Bu + [B 0]tn (7-1) 

y = Cx + [0 1]w. (7.2) 

The weighting matrices for the 7i 2 performance problem are R XX — C T C, Ru U = p — 
5V 2 , and V\ = BB T . The transfer function in Fig. 7.2 is quite clean, which indicates 
that the rate gyro sensor noise is small. Consequently, V 2 in the performance problem 
was chosen to obtain a desired level of closed-loop performance, rather than to reflect 
an anticipated noise level in the system. 

Several optimal LQG controllers were designed for this system using a range of 
values for p = (10 — 2 , 10“ 3 , 6 x 10 -4 ). In the following, designs with lower values 
of p are referred to as having a higher control authority because it is expected that 
the control gains and bandwidth will be larger. An investigation of the loop transfer 
function for the three LQG controllers indicates that the gain and phase margins of 
the two higher authority designs are quite small. In fact, they were both found to be 
unstable when implemented on the actual system. 

The controller (p = 6 x 10 -4 ) shown in Fig. 7.3 illustrates several key character- 
istics of the LQG compensators that led to an instability near 12 Hz. At this level 
of control authority, the system is essentially inverted in the compensator in the 5- 
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15 Hz frequency range. A similar result is seen in many LQG/LTR controllers [152]. 
The lightly damped compensator pole pairs at the frequencies of the plant zeroes (8 
and 12 Hz) are two examples of this plant inversion. The sensitivity of a closed-loop 
system to small changes in the plant parameters when the compensator uses these 
plant inversion techniques was discussed in Chapter 6. 

The loop transfer function with the LQG compensator (p = 6 x 10 -4 ) is plotted in 
Fig. 7.4. The low phase and gain margins at 12 Hz are an indication of the sensitivity 
of this system to plant perturbations. The actual sensitivity is illustrated in Fig. 7.4 
by implementing the compensator on two perturbed models of the system. These two 
modified models of the system were obtained by changing the frequencies of the four 
modes near the zero at 12 Hz by il% of their nominal values. The transfer functions 
with the two perturbed systems demonstrate that small parameter changes can result 
in large changes to the loop magnitude and phase (which now indicate instability). It 
is clear that some knowledge of the uncertainty in the plant poles and zeroes in this 
frequency region must be incorporated into the control design to avoid the sensitivity 
of this so-called plant inversion. 

An approach to modelling the parameter uncertainty in a state space model is 
given in Section 2.2. The section also discusses the difficulties in directly treating 
the frequency uncertainty of a system zero. However, as shown by the intentional 
perturbations in Fig. 7.4, changing the frequencies of the plant poles also has a large 
affect on the system zeroes. Consequently, a good approximation of the problem with 
uncertainty in both the poles and the zeroes is just to consider the uncertainty in 
the system poles. Analysis of several experimental transfer functions indicates that 
the frequencies of the poles and zeroes near 12 Hz are certain to within il% of their 
nominal values. The four modes at 8.8 Hz, 9.4 Hz, 13.3 Hz, and 13.9 Hz will be 
treated as uncertain in these designs. The goal is to obtain the best' possible closed- 
loop performance with a compensator that guarantees stability of the closed-loop 
system for these uncertainties. 

For the design of the robust controllers, the system A matrix in Eq. 7.1 was written 
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Figure 7.4: Loop transfer function with the LQG controller on the 
nominal and intentionally perturbed plant models. 
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in second order canonical form A = block diag(Ai), i = 1, ... , m, where 


Ai = 



1 

-2 CiUJi 


(7.3) 


As discussed in Section 2.2, the uncertainty in the modal frequency is then ap- 
proximated as an uncertainty in wf . The actual dynamics can then be written as 
Ai = Ai + a Ai, where 


, and C oi = [ (jJi 0 ], i = 1, . . . ,m. (7.4) 

The B 0 and C 0 matrices for the full system can be constructed from these two sets. In 
this case, as with many of the examples in Chapter 6, CoiBoi = 0 with this uncertainty 
structure. This observation simplifies R 0 in Eq. 5.4 and dC/ dNo in Eq. 5.48. 

Several robust controllers were designed for this system, with varying bounds on 
the uncertainty. Since the uncertainty is in ujf , the final values in the homotopy must 
be set to ( M 2 f)u = = 0.02. Robust compensators were designed for the 

same three values of p. The BFGS optimization/stability bound homotopy solution 
algorithm discussed in Chapter 5 was used to solve for the optimal compensators. 
Iterative solutions of Eqs. 5.39—5.41 provided initial conditions for the optimization. 
Low authority compensators were typically used to provide initial guesses for the 
higher authority designs. 

The optimal LQG and Popov compensators are compared in Figs. 7.5a and 7.5b. 
The two Popov controllers were designed with different guaranteed stability bounds 
that are presented in Table 7.4. The compensator Gpc2 (Gpc4) guarantees stability 
for 0.5% (1.0%) independent variations in Fig. 7.5a demonstrates that the three 
controllers are quite similar in magnitude for frequencies above and below the region 
of uncertainty (5—15 Hz). In the Popov designs, the LQG poles at 0.45 Hz have been 
replaced with two real poles at approximately 1 Hz and 2.5 Hz. Fig. 7.5b concentrates 
on the uncertain region (5—15 Hz), providing a clear illustration of the differences 
between the Popov and LQG designs. The lightly damped LQG compensator poles 
at about 12 Hz are more heavily damped in the Gpc2 design, a trend that continues in 
the Gpc4 controller. A similar effect can be seen at the plant zero at 8 Hz which is also 


a Ai = SiBoiCoi, Boi — 


0 

-U)i 
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Figure 7.5b: Comparison of LQG (Glqg) and Popov (Gpc2 and Gpc4) 
controllers. Focuses on the region of uncertainty. 
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influenced by these changes in the poles frequencies. The results show that the robust 
compensators are significantly different from the LQG design in the frequency range 
of the uncertainties. Furthermore, they demonstrate that the robustness specification 
does not have many adverse effects on the compensators in other frequency ranges. 

There are several important features of these robust controllers that can be studied 
in more detail. Both the LQG and Gpc2 compensators have a nonminimum phase 
zero at approximately 12.5 Hz. Combined with the pole at about 12 Hz, the result is 
a 300° change in the compensator phase. The corresponding zero is minimum phase 
in the Gpc4 design, resulting in the characteristic “phase blip” in Fig. 7.5b of closely 
spaced minimum phase poles and zeroes. The zero for an intermediate design, Gpc3, 
is also minimum phase, but more lightly damped than the Gpc4 design. The location 
of the compensator zero is important because it indicates a fundamental change in the 
robustification technique. These differences are clearly seen by comparing Figs. 7.4, 
7.6, and 7.7. As discussed before, each graph compares the loop transfer functions 
for the nominal and two perturbed systems. The LQG design gain stabilizes the 
nominal system in the 12 Hz range. Fig. 7.6 illustrates that the Gpc2 controller, which 
has a nonminimum phase zero, also gain stabilizes the loop in this frequency range. 
However, the Gpc4 controller, which was designed for larger guaranteed stability 
bounds, both gain and phase stabilizes the system in this range. 

A comparison of the three figures shows the dramatic difference between the loop 
transfer functions with these compensators. The increase in the gain and phase 
margins for the nominal plant is an indication of a decrease in the sensitivity of 
the compensator. Furthermore, the loop transfer functions indicate that the Gpc4 
controller will not only stabilize the two perturbed system models, but should also 
achieve good closed-loop performance. 

The actual sensitivity of the controllers to plant variations can be obtained from 
the performance robustness curves described in Chapter 6. The closed-loop cost is 
evaluated for several perturbed models of the system. The cost curves, commonly 
called “buckets”, are then obtained by plotting J n0 rmj the cost normalized by the 
open-loop value, versus the system perturbations. As with previous examples, the 
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Figure 7.6: Loop transfer function with a Popov (Gpc2) controller on 
the nominal and intentionally perturbed plant models. 
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Figure 7.8: Robust stability and performance curves for two LQG 
and five Popov controllers. The stability bounds are pre- 
sented in Table 7.3. 

four uncertain frequencies are correlated for this analysis. 

Three robust performance figures are presented. Fig. 7.8 shows the performance 
and robustness of one LQG and five Popov controllers for this uncertain system. No- 
tice that the “stiff” uncertainty direction in these designs now corresponds to positive 
changes in the modal frequencies. Only symmetric sectors were considered here, but 
this knowledge of a difficult direction could be used to refine the stability bounds and 
accentuate the robustness for positive changes. The corresponding stability values 
are given in Table 7.3. Each row of the table corresponds to a curve in Fig. 7.8. 
The nominal performance (zero uncertainty) values are normalized with respect to 
the open-loop cost. The other four values in each row correspond to the stability 
limits. The two middle values are the guaranteed bounds which are always between 
the achieved values. The flatness of these buckets and the small increase in the nom- 
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Figure 7.9: Comparison of LQGl robust stability and performance 
to the guaranteed and achieved Popov results (Gpc4). 
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Figure 7.10: Robust stability and performance curves for two LQG 
controllers and a Popov compensator (Gpc4). 





Table 7.3: Robust performance for the closed-loop system with un- 
certainty in four modes. Frequency uncertainty assumed 
correlated for the analysis. 


Fig. 7.8 
Label 

•Tnorm 

Lower stability bounds 
achieved guaranteed 

Upper stability bounds 
guaranteed achieved 

LQG1 

0.09 

-0.005 

0 

0 

0.000 

LQG2 

0.11 

-0.010 

0 

0 

0.010 

Gpcl 

0.11 

-0.070 

-0.008 

0.008 

0.060 

Gpc2 

0.11 

-0.090 

-0.010 

0.010 

0.070 

Gpc3 

0.11 

-0.250 

-0.016 

0.016 

0.090 

Gpc4 

0.11 

-0.250 

-0.020 

0.020 

0.110 

Gpc5 

0.11 

-0.250 

-0.022 

0.022 

0.120 


inal performance values are quite striking, indicating that guaranteed performance 
robustness can be achieved with only a small increase in the cost. The curves in 
Fig. 7.8 clearly illustrate the increase in the bucket width as the guaranteed range is 
increased. 

An indication of the tightness of the overbounds in the optimization process is 
given in Fig. 7.9. The wider curve corresponds to the achieved performance and 
stability limits with the Gpc4 compensator. The result with the LQG1 controller is 
given for comparison. The third curve corresponds to the guaranteed bounds used in 
the optimization of Gpc4. The two vertical asymptotes at ±0.02 correspond to the 
values of M\ and M 2 . The depth of the curve is given by the optimal value of the cost 
over bound (0.12). As expected, the Popov controller achieves a nominal cost that lies 
between the optimal LQG value and the overbounding cost. These results show that 
the cost function of the auxiliary minimization problem in Chapter 5 is a relatively 
tight upper bound. While the discrepancy in the guaranteed and achieved bounds 
is, to some extent, a measure of the conservatism in the robustification technique, 
it is also a reflection of the relative ease of robustifying the system to this type of 
uncertainty. 

Table 7.3 provides the cost and stability values for two LQG designs. The first 
design refers to the optimal controller for the problem as specified earlier. The second 
is a suboptimal LQG design developed using Ruu and V 2 values that are increased by 
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Table 7.4: Optimal diagonal multipliers for four Popov controllers 
with p = 6 x 10 -4 . 


Uncertain 

Mode 

Gpc2 
Ho No 

Gpc3 
Ho No 

Gpc4 
Ho No 

Gpc5 
Ho No 

8.83 Hz 

17.79 

0.027 

14.18 

0.053 

4.66 

0.050 

4.58 

0.057 

9.40 Hz 

9.82 

0.045 

8.10 

0.043 

8.39 

0.043 

8.33 

0.045 

13.30 Hz 

17.83 

0.025 

13.23 

0.025 

11.83 

0.026 

11.71 

0.028 

13.88 Hz 

1.00 

0.081 

1.00 

0.080 

1.00 

0.082 

1.00 

0.083 


a factor of 3. This controller achieves a nominal performance value that is compa- 
rable to those achieved by the five Popov designs. However, the results in Fig. 7.10 
demonstrate that simply reducing the control authority and designing a suboptimal 
compensator does not produce a significantly more robust design. 

Table 7.4 compares the optimal multiplier values for the last four Popov designs. 
In each case, the last diagonal element of Ho was set to 1 and the other numbers 
were optimized relative to this value. The initial values were set at H 0 = [30 20 10 1] 
and N 0 = 0.02I 4 . The results indicate that large changes in H 0 and N 0 occur as 
M 2 is increased. These changes in turn demonstrate the importance of allowing the 
multipliers to vary in the synthesis of the robust controllers. 

The next step is to compare the predicted closed-loop performance for the LQGl 
and Gpc4 controllers. The results, shown in Fig. 7.11, illustrate that the robust Popov 
controller exerts a significant influence on the flexible modes of the structure, even 
in the region of uncertainty. Recall that this LQG controller actually destabilizes the 
experimental system. With p = 6 x 10 -4 , the predicted performance improvement 
with the LQG controller is 11.23 dB. The Popov design is predicted to achieve a 
10.36 dB reduction; a ratio that agrees with the results in Table 7.3. The changes 
required in the compensator to achieve greater robustness are clearly evident in the 
closed-loop curves. 

The continuous time controllers were discretized and implemented on the AC100 
at 1 KHz. The experimental results are presented in Fig. 7.12 with p = 10 -3 and 
in Fig. 7.13 with p = 6 x 10 -4 . The graphs compare the open and closed-loop 
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Figure 7.11: Predicted closed-loop performance with the LQG and 
Popov (Gpc4) controllers on the 24 state model. 

results with two robust controllers. In each plot, the closed-loop results with the 
last LQG design that stabilized the experimental system ( p = 10 -2 ) are shown for 
comparison. This lower authority design corresponds to an 8.97 dB improvement in 
the performance. By comparison, the Popov controller in Fig. 7.12 yields a 10.78 dB 
performance improvement. The one in Fig. 7.13 achieves an 11.38 dB improvement, 
which is within 1 dB of the predicted result. 

A comparison of the curves in Figs. 7.11, 7.12, and 7.13 shows that the predicted 
and experimental results agree very well. However, there are some differences. The 
zero at 1.2 Hz is much stronger in the experimental curves than in the predicted 
results. As shown in Fig. 7.5a, both the LQG and Popov designs have compensator 
poles at this frequency. The predicted closed-loop results show that these compensator 
poles essential cancel a plant zero. However, this cancellation is not as exact in the 
experimental results, which indicates that the frequencies of the compensator pole and 
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Frequency Hz 

Figure 7.12: Performance comparison between open-loop, the last sta- 
ble LQG controller (p = 10~ 2 ), and a Popov design Gpc6 

{p = 10 -3 ). 

the plant zero do not match as well as they do in the model. This slight mismatch 
in the frequencies is an example of the type of problem that led to an instability at 
12 Hz with the LQG controllers. 

There is also a problem in the closed-loop results at 32-33 Hz. The peak in the 
transfer function is an indication that a mode has been adversely affected by the 
controller. Similar results were obtained from several experiments on the z-axis using 
a variety of design approaches. The source of this problem is unknown, but is probably 
related to the poor modelling of a plant zero in the 32—35 Hz frequency range. An 
attempt to improve the performance in this region by treating the two plant modes 
at 36 Hz and 42 Hz as highly uncertain lowered the response at this frequency by a 
factor of 2. 

The Popov controllers for this SISO experiment can be compared with several oth- 
ers that have been developed using the sensitivity weighted LQG (SWLQG), multiple 
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Figure 7.13: Performance comparison between open-loop, the last sta- 
ble LQG controller (p = 10 -2 ), and a Popov design Gpc4 
{p = 6 x IQ" 4 ). 


model (MM), and Maximum Entropy (ME) techniques discussed in the Introduction. 
The SWLQG and MM designs in Refs. [58,59] are similar to the Popov design (Gpc2) 
because, in all three cases, the system robustness is increased by gain stabilization. 
An ME controller that both gain and phase stabilizes the system in the 11-13 Hz 
frequency range was developed by increasing the parameter in the stochastic model 
of the uncertainty. The resulting compensator can then be compared to the Gpc4 
Popov design. 

However, it is difficult to accurately compare these controllers because of the 
trade-offs between stability robustness and nominal/robust performance. For the 
compensators considered here, the MM and Popov robustification techniques did not 
degrade performance as much as the SWLQG approach. The ME designs achieved 
slightly better nominal performance than the other three approaches. Of course, a 
key difference between these four techniques is the robustness guarantees that they 
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provide. As discussed in the Introduction, the SWLQG approach is ad hoc and 
does not offer any guarantees of robust stability. The MM controllers only provide 
guarantees for a small number of system models, which represent specific combinations 
of the parameter uncertainties. The compensator can still exhibit sensitivity, and 
even instability, for other combinations of the. uncertainties. Finally, with the ME 
technique, it is often difficult to correlate the uncertainty added in the stochastic 
model of the system to the robustness levels achieved by the controller. 

In contrast to these three approaches, the Popov compensators guarantee robust 
stability for independent variations of each uncertainty. Furthermore, the results in 
Table 7.3 show that good closed-loop performance can be achieved with guaranteed 
stability bounds that exceed ±1% in the nominal frequencies. For this lightly damped 
system, these frequency shifts correspond to 60° - 100° changes in the frequency 
response of the system. A robustness technique that provides such large stability 
guarantees has many advantages for an experimental system, such as MACE, with 
potentially large parameter uncertainties. Section 7.5 discusses a control design tech- 
nique that combines the various numerical/robustness advantages of these sensitivity 
weighted, multiple model, and Popov design techniques. 

7.4 Demonstration of Robust Performance 

This section describes the results of an experiment that was designed to demonstrate 
the robust performance that can be achieved by the Popov compensators. The ro- 
bustness of the controllers was shown by intentionally modifying the MACE hardware 
to change the frequencies of the poles and zeroes. In this experiment, the mass of the 
second payload was changed by adding several aluminum plates. A total of 1.6 kg 
was added to the existing 7 kg mass. The results, shown in Figs. 7.14a and 7.14b, 
demonstrate that only the modes in the 5—15 Hz range are significantly modified by 
this perturbation to MACE. The curves also clearly show that both the poles and 
zeroes are affected by the extra mass. The changes in the two low frequency suspen- 
sion modes reflect the fact that the suspension system had to be reset after each mass 
addition. 
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Figure 7.14a: Open-loop transfer functions with variations in the mass 
of the second payload. Mass perturbations and pole vari- 
ations are given in Table 7.5. 
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Figure 7.14b: Open- loop transfer function with variations in the mass 
of the second payload. Mass perturbations and pole vari- 
ations are given in Table 7.5. 
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Table 7.5: Effect of changes in the mass of the second payload on 
the open-loop poles. 


Nominal 

AM = 3% 

AM = 5% 

AM = 12% 

AM = 22% 

-0.15 ±7.13; 

-0.16 ±7.09;? 

-0.17 ±7.18;? 

-0.17 ±7.16; 

-0.18 ±7.02; 

-0.6% 

0.7% 

0.4% 

-1.5% 

—0.06 ± 8.85; 

-0.06 ±8.96;? 

-0.08 ± 9.02; 

-0.08 ±9.08; 

-0.08 ±9.05; 

1.2% 

1.9% 

2.6% 

2.3% 

-0.07 ±9.41;7 

-0.08 ±9.36.7 

-0.07 ±9.39; 

-0.06 ± 9.53; 

-0.06 ±9.83; 

-0.5% 

-0.2% 

1.3% 

4.5% 

—0.09 ± 13.31; 

—0.08 ± 13.45; 

-0.07 ± 13.49; 

-0.06 ± 13.46; 

-0.06 ± 13.39; 

1.1% 

1.4% 

1.1% 

0.6% 

—0.09 ± 13.88.J 

-0.10 ±13.95.7 

-0.10 ± 14.00; 

-0.12 ±14.29; 

-0.14 ± 14.82; 

0.5% 

0.9% 

3.0% 

6.8% 


Fig. 7.14b concentrates on the 5-20 Hz frequency range to show the changes that 
occur in the plant poles and zeroes. The open-loop poles and the percentage change 
from their nominal frequencies are given in Table 7.5. For a 20% variation in the 
payload mass, the modal frequencies vary by as much as 6.5%. Each of the modes is 
affected differently by the mass perturbation, so the robustness results are not exactly 
equivalent to those considered previously in Fig. 7.8. 

The robust controllers in the previous section were not designed for this mass un- 
certainty. However, it is clear from these figures that uncertainty in this payload mass 
is primarily reflected as uncertainties in the poles and zeroes in the 5-15 Hz frequency 
range. Consequently, intentionally changing the mass of the second payload should 
be an effective means of demonstrating the robust performance of the controllers. 

A Popov compensator (Gpc6) with p = 10 -3 and M2 = —Mi = O.O22I4 was 
implemented on each of the open-loop systems in Fig. 7.14a. The experimental closed- 
loop results with AM = 0.05 and AM = 0.12 are shown in Figs. 7.15a and 7.15b. Two 
plots are used for each compensator to show the overall effect and the performance 
in the region of uncertainty. Recall that at this level of control authority, the LQG 
design destabilizes the actual system even without any intentional perturbations. The 
graphs compare the open and closed-loop transfer functions on the system with no 
perturbations to the closed-loop results on the perturbed plant. The figures show 
that the closed-loop performance is essentially unchanged from the nominal result for 
both perturbations to the payload mass. These results clearly demonstrate the good 
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robust stability and performance that are guaranteed for this system. 

For comparison with the results in Table 7.4, the optimal multipliers for the Gpc6 
compensator are H 0 = diag(5.13, 8.98, 12.84, 1.00) and N 0 = diag(0.064, 0.052, 0.032, 
0.092). These results further illustrate the need to treat the multiplier values as free 
parameters in the compensator design. 

7.5 MIMO Control Design 

The previous sections presented a detailed analysis of a single-axis controller for 
MACE. However, to achieve the desired levels of performance on the f ull y noncollo- 
cated MACE system, it is anticipated that MIMO controllers will have to be devel- 
oped. Thus, the goal of this section is to extend the SISO results and discuss the 
design and implementation of a 3-input/3-output robust controller. 

The development of the design model for this case is similar to the process for 
the SISO system. Of course, because more modes are observable in the transfer 
functions, the process is much more difficult. To obtain the nine transfer functions, 
a disturbance was applied about each of the AT, Y , and Z bus axes using different 
combinations of the torque wheels. The transfer functions between each input and 
the three rate gyro sensors were measured. The identification was performed on 
each of the three single-input three-output systems. The result was three subsystem 
models which were combined using the approach discussed by Gilpin [56]. A potential 
problem exists with these subsystem models if a mode is identified differently in the 
subsystems. Ref. [6] provides an example of the scatter in the data that can be 
expected in the identification of six sets of transfer functions for a complex system. 
The duplicated modes must either be repeated or approximated in- the model. In 
this MIMO example, the three subsystems were combined to form a single 50 state 
model. The MIMO compensators were implemented on the AC-100 at 500 Hz, so a 
3 pole Pade approximation of the 15.2 msec time delay was included in each output 
channel, for a total of 59 states. 

Grocott et al. [59] suggest a technique based on the multivariable Nyquist and 
Nichols criteria to determine the frequency ranges in which the system uncertainty 
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Figure 7.15a: Experimental demonstration of robust performance with 
the Popov controller (Gpc6) on the hardware with a 5% 
variation in the mass of the second payload. 
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Figure 7.15b: Experimental demonstration of robust performance with 
the Popov controller (Gpc6) on the hardware with a 12% 
variation in the mass of the second payload. 
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is most important. The process is particularly effective if the loop transfer function 
is based on the measured open-loop data. Note that in this case, the multivariable 
zeroes must be considered for this system, and these are not necessarily related to the 
zeroes of the individual transfer functions. The open-loop data indicate that there is 
a sufficient level of coupling in the system to require a full MIMO control design. 

For this system, eleven out of twenty five modes were identified as requiring some 
level of robustification. The scale of this problem compared to the SISO design dis- 
cussed in the previous sections (59 states instead of 24 and 11 uncertainties instead 
of 4) required that a much better initial guess be obtained for the optimization pro- 
cess. The approach adopted here was to build on the results in Grocott et al. [59]. 
These authors develop robust controllers using a multiple model approach with ini- 
tial guesses based on sensitivity weighted LQG designs. In this thesis, these optimal 
multiple model controllers were combined with estimates of the guaranteed stability 
bounds and the multipliers to form an initial condition for the Popov optimization. 
Recent results indicate that Maximum Entropy controllers would also provide good 
initial guesses. 

These other designs are currently easier to solve numerically, but they offer no 
guarantees of robustness. However, with these as an initial guess, the Popov con- 
trollers can be found more quickly. Using these initial guesses results in an approach 
that significantly reduces the overall computational effort. As discussed in Chapter 5, 
the final design is a controller that guarantees robust stability and performance for 
independent variations in the uncertainties. The design sequence then leads to a uni- 
fied approach to robust control design, with each step providing further guarantees 
in the robustness of the closed-loop system. 

The MIMO design uses three rate gyro signals as sensors and performance vari- 
ables and torques about the three bus axes as the disturbance and control inputs. 
The state cost for the H .2 problem is defined as 

J xx = 0.2al + cry + crl, (7-5) 

where of is the variance of the inertial angular motion for each bus axis. X-axis motion 
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Figure 7.16: MIMO closed-loop performance comparison showing the 
results with the best stable LQG design and the robust 
Popov controller. 

is weighted less heavily because rotation about this axis has a smaller influence on 
the payload pointing angle, which is the overall objective of the MACE project. 

A single MIMO robust controller with R uu = 2 x 10 -2 I 3 = 10V 2 was designed for 
this system. The uncertain modes, the guaranteed upper and lower stability limits, 
and the optimal multiplier for these bounds axe presented in Table 7.6. Recall that 
typically one element of H 0 is fixed in the optimization. Several attempts were made 
to develop initial guesses of the multiplier matrices by fixing the first element of H 0 
to unity. However, in these cases, the optimization would result in negative values of 
H 0 . A technique for restricting the positive definiteness of H 0 and N 0 was discussed 
in Section 5.3. A second approach is to fix different elements of the H 0 matrix. Based 
on the experience from the SISO designs, the last H 0 value was fixed at 20. In this 
case, as shown in the table, the resulting optimal values are positive. The relatively 
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Table 7 . 6 : Optimal multiplier and stability bounds for a MIMO 
Popov controller. 


Mode Hz 

£ 

1 

II 

£ 

Ho 

No 

1.40 

0.067 

2.29 

0.059 

3.35 

0.022 

4.83 

0.125 

4.88 

0.028 

6.79 

0.152 

5.92 

0.058 

10.00 

0.153 

8.76 

0.028 

11.00 

0.152 

8.91 

0.022 

18.95 

0.205 

9.42 

0.022 

14.92 

0.190 

13.31 

0.022 

16.92 

0.183 

13.90 

0.028 

12.97 

0.177 

14.80 

0.022 

20.91 

0.171 

33.78 

0.022 

20.00 

0.063 


large M 2 values for the 1.4 Hz and 5.9 Hz modes reflect 


a high uncertainty in the 


zeroes in these frequency ranges. 

To compare the experimental performance of the best stable LQG design and the 
Popov controller, we can write the state cost as 

J = / + “ tr Cr d (ju)QGd{p>) du, (7.6) 

J — CO 


where 


Q = 


0.2 0 0 
010, 
0 0 1 


(7.7) 


and Gd(s ) is a frequency domain representation of the closed-loop system. The 
square root of the integrand of this cost is plotted in Fig. 7.16. With uncorrelated 
disturbances of equal intensity, this plot is analogous to the transfer function from 
the disturbance source to the performance metric in the SISO case [59]. The LQG 
result in the figure corresponds to the best performance that could be achieved using 
this approach without destabilizing the testbed. 

The solid line in this figure corresponds to the open-loop system. Notice that 
significantly more modes are observable in this transfer function than in the equivalent 
SISO plots. The next line is the best performance that could be achieved using LQG 
controllers. The lowest line corresponds to the Popov design. The performance 
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improvements are 10.2 dB for LQG and 12.4 dB for Popov. The multiple model 
design used as an initial guess for the optimization achieved a 12.6 dB performance 
improvement, but this is obtained with fewer guarantees of stability for the eleven 
uncertain modes. 

The additional robustness constraints can result in a degradation in the closed-loop 
performance on the system model. However, because the sensitivity of the controllers 
to changes in pole and zero frequencies is guaranteed to decrease, it is possible to 
achieve much better performance on the experimental hardware. 

7.6 Summary 

Several robust controllers were designed and implemented on the development model 
of the Middeck Active Control Experiment (MACE). The results demonstrate the 
feasibility of Popov controller synthesis for large order systems and illustrate the ca- 
pabilities of the design approach for complex systems with multiple constant real 
uncertainties. The controllers were developed to reduce the sensitivity of the LQG 
designs that destabilized the system for high levels of control authority. The ro- 
bustness curves show that the overbounding cost functions in Chapters 4 and 5 are 
not overly conservative for the problem with constant real parameter uncertainty. 
Good robust performance with a Popov controller was demonstrated experimentally 
by intentionally changing the mass of the second payload on MACE. 
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Chapter 8 


Conclusions and 
Recommendations 

8.1 Summary 

This thesis investigates an alternative approach to robust control design for sys- 
tems with real parameter uncertainties. The approach directly considers nonlin- 
ear parameter uncertainties and treats linear uncertainties as a special case of this 
much broader class. The analysis and synthesis problems axe investigated for several 
classes of nonlinear uncertainties. The supply rate and storage function concepts of 
Willems [165, 166] were demonstrated to significantly simplify the derivation of the 
state space stability criteria. The recent work by Haddad and Bernstein on sector- 
bounded nonlinearities [66,69] was reformulated and extended in this thesis using the 
wealth of literature on absolute stability theory [2, 123, 131, 172]. The storage func- 
tions were combined to form parameter-dependent Lyapunov functions that restrict 
both the allowable time- variation and the class of the nonlinear uncertainties. The 
stability analysis was developed for time-invariant real nonlinear uncertainties, but 
can also be used to represent constant linear real uncertainties. 

As discussed in Chapter 3, graphical frequency domain tests played a crucial role 
in the original developments of absolute stability theory. Frequency domain analysis 
tests also played a crucial role in this thesis. Most importantly of all, these tests pro- 
vide a direct connection between this approach based on nonlinear stability theory 
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from the 1960’s and current work on mixed /z and K m synthesis [141,170]. This con- 
nection has largely been ignored in many of the recent developments in robust control, 
but unifies these two diverse bodies of research. Furthermore, the observation indi- 
cates that the stability multipliers are a parameterization of the /z scaling functions 
and that /z theory is just a generalization of the results from absolute stability theory. 
A geometric interpretation in terms of frequency dependent off-axis circles clarifies 
the important role of the multiplier phase in these stability criteria. This interpre- 
tation provides a qualitative indication of the conservatism in a particular selection 
of the multipliers (scaling functions), which is not provided by fi theory. Finally, 
the interpretation shows that both the magnitude and phase of the uncertainty are 
considered in the robustness tests. 

The state space criteria that guarantee stability are included in an W 2 performance 
objective to provide a powerful tool for the design of robust controllers. Robustness 
and performance are combined using the 12-bound fixed structure framework devel- 
oped by Bernstein and Haddad [23]. It is demonstrated that conservatism can be 
further reduced in this approach by optimizing the cost functional with respect to 
the free parameters in the stability multiplier. The result is a numerical synthesis 
algorithm in which the fixed-order controller and multiplier matrices are optimized 
simultaneously. The approach avoids the explicit D-K iteration required by the /z 
and K m synthesis techniques. Architecture constraints on the controller, which are 
essential for most realistic systems, can also be included in the state space optimiza- 
tion. 

Finally, several controllers were designed using the analysis test based on the 
Popov stability multiplier. Both low-order benchmark problems and more compli- 
cated experiments were considered. The low-order examples demonstrate the modifi- 
cations to the compensator that are required to achieve guaranteed robust stability. 
The more complicated experiments demonstrate that the approach is feasible for 
more realistic systems. Several SISO and MIMO controllers were implemented on 
the Middeck Active Control Experiment (MACE). The experimental results indicate 
that guaranteed stability robustness can be achieved for complex systems with mul- 
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tiple uncertainties. Moreover, these guarantees can be achieved without significant 
sacrifices in the performance. In fact, extremely good robust performance was ex- 
perimentally demonstrated on MACE by intentionally changing the structure with 
additional mass at one payload. 

8.2 Conclusions and Contributions 

1: The results in this thesis show the many connections between mixed /z and absolute 
stability theory. In particular, it is shown that the upper bounds for mixed /z are 
just a generalization of the results obtained from absolute stability theory. This 
important observation has largely been ignored in many recent developments in 
robust control theory, but unifies these two diverse bodies of research. Similar 
connections are developed between the approach in this thesis and concurrent 
work on K m synthesis by Safonov et al. [34, 142]. The results in this thesis are 
considered to be an extension of /z theory, because both linear and nonlinear real 
parameter uncertainties are analyzed. 

2: Both state space and frequency domain criteria are developed for several nonlin- 
earities and stability multipliers using the wealth of literature on absolute stability 
theory. In the process, it is demonstrated that the concepts of supply rates and 
storage functions from Ref. [165] provide a powerful framework for developing 
stability criteria. By considering the monotonic and odd monotonic classes of 
nonlinear functions, the state space criteria in this thesis extend recent work by 
Haddad and Bernstein on sector-bounded nonlinearities [66]. The stability crite- 
ria are written in terms of Riccati equations and parameter-dependent Lyapunov 
functions. Based on the connections discussed previously, it can also be concluded 
that these results provide parameter-dependent Lyapunov functions to support the 
mixed /z results of Doyle et al. [53]. 

3: An interpretation of the equivalent frequency domain criteria in terms of off-axis 
circles clarifies several features of the robustness tests. The frequency dependent 
location of the circle centers illustrates the important role of the multiplier phase. 
These conditions also demonstrate that both the magnitude and phase of the 
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uncertainty are considered, which, as discussed in the Introduction, is essential 
for problems with real parameter uncertainties. This geometric interpretation 
indicates that the more general multipliers associated with the monotonic and odd 
monotonic nonlinearities provide even less conservative robustness tests, because 
there is more freedom to control the location of the circle centers. 

4: The robust controller synthesis problem is addressed using the 12-bound frame- 
work of Haddad and Bernstein [23]. The performance objective for the control 
design is specified in terms of an 1~L 2 cost functional. The state space stability 
criteria are used to develop an auxiliary minimization problem with an overbound 
of this cost. Both static and dynamic feedback controllers are presented in the 
thesis. The optimal reduced-order designs are written in terms of the solutions 
of coupled Riccati and Lyapunov equations. A quasi-Newton optimization with a 
homotopy on the stability bounds was developed to solve the robustness problem 
based on the Popov stability multiplier. A key advantage of this combined W 2 /real 
H synthesis technique is that it avoids the explicit D—K iteration of fi synthesis 
by optimizing the controller and multiplier values simultaneously. Furthermore, 
order and architecture constraints on the compensator can easily be included in 
the optimization [109]. These constraints are essential for most realistic systems, 
but cannot be incorporated into the 'Hoo design approach. Several compensators 
were designed using this Popov controller synthesis approach. The results are 
typically presented as a family of controllers to illustrate the trade-offs between 
performance and guaranteed robustness. 

5: The numerical examples on the benchmark problems and the laboratory exper- 
iments on MACE serve to illustrate that this approach is a very powerful alter- 
native for robust controller synthesis. The low-order numerical examples clearly 
illustrate the mechanisms by which the robustness is achieved. The more com- 
plicated experiments demonstrate that the design technique is feasible on more 
realistic systems. Furthermore, the experiments on a lightly damped structure 
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with uncertain pole and zero frequencies show that Popov controller synthesis 
results in good performance with relatively large robust stability guarantees. 

8.3 Recommendations 

1: The complete synthesis approach is given in Chapter 4 using the stability criteria 
with the extended multipliers. Synthesis with the Popov stability multiplier was 
used to illustrate that the conservatism can be reduced even further by optimizing 
an overbounding cost functional with respect to the multipliers. This approach 
can also be applied to the case with the extended multipliers, but there are sev- 
eral difficulties. First of all, the derivation of the optimality conditions for the 
multipliers is complicated by the fact that the multiplier coefficients appear in 
the A a matrix. A second problem is that the constraints on the multiplier coeffi- 
cients in Eq. 4.9 will require that the controllers be designed using a constrained 
optimization algorithm. 

2: As mentioned in Remark 3.6, the results in this thesis can be extended by in- 
cluding more general parameterizations of the multipliers for the odd monotonic 
nonlinearities. A more fundamental extension is the possibility of developing a 
parameter-dependent Lyapunov function for the Nyquist criterion using the LC 
class of multipliers [63, 118, 157]. These new multipliers have poles and zeroes on 
the imaginary axis and thus provide even more general functions of the multiplier 
phase. 

3: Collins et al. [38] have recently developed a numerically robust technique for de- 
signing full-order Maximum Entropy controllers, and it is believed that many of 
the ideas in this new algorithm can be applied to the Popov synthesis problem [36]. 
Unfortunately, the numerical difficulties with reduced-order designs still exist, al- 
though Collins et al. [37, 38] present some major extensions of the approach by 
Mercadal [109]. 

4: One problem with research on space structures is that measurement based models 
cannot be developed for many systems. In these cases, we must rely on finite 
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element models (FEM) to design controllers. As might be expected, the errors in 
these FEM’s tend to be much larger than those in measured models. An important 
extension of the work in this thesis would be to develop a controller that is robust 
the errors in a FEM of the system. In this case, performance could be achieved 
without the extensive effort necessary to develop measured models or upgrade 
the FEM. This problem is particularly important for the MACE project because 
gravity effects have been shown to have such a large effect on structures [12,43]. 
Even with current prediction techniques based on the FEM, these changes will 
result in large parameter uncertainties in the model [134]. 
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